User terminal device for displaying application and methods thereof

ABSTRACT

An electronic device including a display of a main surface area and a curved surface area extended from the main surface area, and a controller configured to: control the display to present a preview image on the main surface area and a user interface (UI) on the curved surface area, the UI comprising a UI element for photographing an image, control the display to present the UI element at a first location in the curved surface area while the electronic device is in a landscape state, and control the display to present the UI element at a second location in the curved surface area while the electronic device is in a portrait state.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a Continuation patent application of U.S.application Ser. No. 14/329,179, filed on Jul. 11, 2014, in the UnitedStates Patent and Trademark Office, which claims the benefit of U.S.Provisional Patent Application No. 61/845,023, filed on Jul. 11, 2013and U.S. Provisional Patent Application No. 61/845,036, filed on Jul.11, 2013, in the United States Patent and Trademark Office, and claimspriority from Korean Patent Application No. 10-2013-0143298, filed onNov. 22, 2013 in the Korean Intellectual Property Office, thedisclosures of which are incorporated herein by reference in theirentireties.

BACKGROUND

1. Field

Apparatuses and methods consistent with exemplary embodiments relate toa user terminal device for displaying contents and methods thereof, andmore specifically, to a user terminal device configured to displaycontents by using a bended touch screen which is divided into main areaand one or more sub areas and methods thereof.

2. Description of the Related Art

Various types of user terminal devices are being developed and providedwith the advancement of the electronic technologies. Recently, as thesizes of user terminal devices have become minimized and the functionsthereof more diversified, user demand for user terminal devices hasincreased.

A user terminal device may provide a variety of contents such asmultimedia contents or application screens according to a request of auser. A user may select a function that they desire by using buttons ora touch screen provided on the user terminal device. The user terminaldevice may display executing results by selectively executing programsaccording to a user interaction.

However, as user terminal devices become more diversified, there is agrowing need for improved content display methods or user interactionmethods that can be provided from the user terminal devices. Morespecifically, as the types and functions of contents increase,interaction methods of the related art, such as simply selecting buttonsor touching a touch screen of a user terminal device, are notsufficient.

Therefore, new user interaction technologies which enable a user to usea user terminal device by more convenient methods are required.

SUMMARY

Exemplary embodiments address at least the above problems and/ordisadvantages and other disadvantages not described above. However,exemplary embodiments are not required to overcome the disadvantagesdescribed above, and an exemplary embodiment may not overcome any of theproblems described above.

One of more exemplary embodiments provide a user terminal device capableof displaying a variety of contents using a bended touch screen dividedinto a main area and one or more sub areas, and methods thereof.

According to an aspect of an exemplary embodiment, there is provided acontent display method of a user terminal device including a bendedtouch screen divided into a main area and a sub area, wherein the mainarea and the sub area are defined by a bending line, and a surfaceincluding the main area and a surface including the sub area form anobtuse angle therebetween, the content display method including:displaying, on the main area, a first main content provided by a firstapplication, and displaying, on the sub area, a first sub contentassociated with the first main content, receiving a first user gestureinput on the main area, and in response receiving to the first usergesture, displaying, on the main area, a second main content provided bya second application, and displaying, on the sub area, a second subcontent associated with the second main content.

The first and second applications may be different applications.

The first sub content may include an object that represents a side ofthe first main content such that the first main content is representedthree-dimensionally.

The content display method may additionally include receiving a seconduser gesture selecting the first main content, and in response to thesecond user gesture, marking the first main content and the first subcontent associated with the first main content.

The displaying, on the main area, the first main content provided by thefirst application, and the displaying, on the sub area, the first subcontent associated with the first main content may additionally include:displaying, on the main area, a third main content provided by a thirdapplication, and displaying, on the sub area, a third sub contentassociated with the third main content. The third sub content may bedisplayed in a same area of the sub area as the first sub content.

The first sub content may be an object displayed in a form of a filmcontainer, and the first main content may be displayed within an objectdisplayed in a form of film extracted out of the film container.

The first main content may be a content that is included in a first pageof a plurality of pages, and in response to the first main content beingselected, the content display method may additionally includedisplaying, on the main area, moving the selected first main content toa second page of the plurality of pages.

The sub area may include a plurality of sub areas, and wherein thedisplaying may include displaying, on a first sub area among theplurality of sub areas, the first sub content associated with the firstmain content, and displaying, on a second sub area among the pluralityof sub areas, an object that corresponds to one of a page and a layercomprising the first main content therein.

The content display method may additionally include displaying, on themain area, a shortcut icon that corresponds to a third applicationinstalled on the user terminal device.

The first main content may include a content provided by a first widgetof the first application, and the second main content comprises acontent provided by a second widget of the second application.

The first widget may include a plurality of contents, and the displayingmay include displaying, on the sub area, sub contents of the pluralityof contents.

According to an aspect of another exemplary embodiment, there isprovided a user terminal device including: a bended touch screen dividedinto a main area and a sub area, wherein the sub area is smaller thanthe main area, the main area and the sub area are defined by a bendingline, and a surface including the main area and a surface including thesub area form an obtuse angle therebetween; a memory configured to storea first application and a second application; and a controllerconfigured to control the bended touch screen to display, on the mainarea, a first main content provided by the first application, anddisplay, on the sub area, a first sub content associated with the firstmain content, and in response to a first user gesture being input on themain area to control the bended touch screen to display, on the mainarea, a second main content provided by the second application, anddisplay, on the sub area, a second sub content associated with thesecond main content.

The first and second applications may be different applications.

The first sub content may include an object that represents a side ofthe first main content such that the first main content may berepresented three-dimensionally.

In response to the controller receiving a second user gesture selectingthe first main content, the controller may be further configured tocontrol the bended touch screen to mark the first main content and thefirst sub content associated with the first main content.

The controller may be further configured to control the bended touchscreen to display, on the main area, a third main content provided by athird application, and display, in a same area of the sub area where thefirst sub content is displayed, a third sub content associated with thethird main content.

The first sub content may be an object displayed in a form of a filmcontainer, and the first main content may be displayed within an objectdisplayed in a form of film extracted out of the film container.

The first main content may be a content that is included in a first pageof a plurality of pages, and in response to the first main content beingselected, the controller may be further configured to control the bendedtouch screen to display, on the main area, moving the selected firstmain content to a second page of the plurality of pages.

The sub area may include a plurality of sub areas, and wherein thecontroller may be further configured to control the bended touch screento display, on a first sub area among the plurality of sub areas, thefirst sub content associated with the first main content, and display,on a second sub area among the plurality of sub areas, an object thatcorresponds to one of a page and a layer comprising the first maincontent therein.

The controller may be further configured to control the bended touchscreen to display, on the main area, a shortcut icon that corresponds toa third application installed on the user terminal device.

The first main content may include a content provided by a first widgetof the first application, and the second main content may include acontent provided by a second widget of the second application.

The first widget may include a plurality of contents, and wherein thecontroller may be further configured to control the bended touch screento display, on the sub area, sub contents of the plurality of contents.

According to an aspect of another exemplary embodiment, there isprovided a user terminal device including: a touchscreen including aflat front surface portion and a curved side surface portion; and acontroller configured to control the touchscreen to display, on the flatfront surface portion, a first main content provided by a firstapplication, and display, on the curved side surface portion, a firstsub content associated with the first main content, and in response to auser gesture being input on the flat front surface portion, to controlthe touchscreen to display, on the flat front surface portion, a secondmain content provided by the second application, and display, on thecurved side surface portion, a second sub content associated with thesecond main content.

The touchscreen may include a first touchscreen including the flat frontsurface portion and a second touchscreen including the curved sidesurface portion.

According to an aspect of another exemplary embodiment, there isprovided a user terminal device including: a front surface that is atouchscreen; a rear surface; a side surface that is a touchscreen; and acontroller configured to control the touchscreen to display, on thefront surface, a first main content provided by a first application, anddisplay, on the side surface, a first sub content associated with thefirst main content, and in response to a user gesture being input on thefront surface, to control the front surface to display a second maincontent provided by the second application, and control the side surfaceto display a second sub content associated with the second main content.

The front surface and the side surface may form a same touchscreen.

According to an aspect of another exemplary embodiment, there isprovided a user terminal device including: a touchscreen including aplanar main area and a deformed sub area; and a controller configured tocontrol the touchscreen to display, on the planar main area, a firstmain content provided by a first application, and display, on thedeformed sub area, a first sub content associated with the first maincontent, and in response to a user gesture being input on the planarmain area, to control the touchscreen to display, on the planar mainarea, a second main content provided by the second application, anddisplay, on the deformed sub area, a second sub content associated withthe second main content, and wherein the planar main area and thedeformed sub area are respectively disposed on adjacent sides of theuser terminal device.

According to an aspect of another exemplary embodiment, there isprovided a user terminal device including: a front surface that is aflat touchscreen; a rear surface; a side surface connecting the frontsurface to the rear surface and including a convex touchscreen; and acontroller configured to control the flat touchscreen to display a firstmain content provided by a first application, and control the convextouchscreen to display a first sub content associated with the firstmain content, and in response to a user gesture being input on the flattouchscreen, to control the flat touchscreen to display a second maincontent provided by the second application, and control the convextouchscreen to display a second sub content associated with the secondmain content.

The side surface may further include a support portion connecting theconvex touchscreen to the rear surface.

According to the various exemplary embodiments above, a user may displayvarious applications by using the bended touch screen. Therefore, userconvenience or user satisfaction is enhanced.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and/or other aspects of the will become more apparent bydescribing certain exemplary embodiments with reference to theaccompanying drawings, in which:

FIG. 1 is a block diagram of a user terminal device according to anexemplary embodiment;

FIGS. 2 to 10 illustrate various examples regarding the constitution ofa bended touch screen;

FIG. 11 is a block diagram of the user terminal device according tovarious exemplary embodiments;

FIG. 12 illustrates an example of a software structure of the userterminal device;

FIGS. 13 and 14 illustrate various examples of layouts of a main areaand sub areas;

FIGS. 15 to 100 illustrate examples of interaction screens which aredisplayed on the user terminal device according to various exemplaryembodiments; and

FIGS. 101 to 105 are flowcharts provided to explain display methods ofinteraction screens on the user terminal device according to variousexemplary embodiments.

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS

Certain exemplary embodiments will now be described in greater detailwith reference to the accompanying drawings.

In the following description, same drawing reference numerals are usedfor the same elements, even in different drawings. The matters definedin the description, such as detailed construction and elements, areprovided to assist in a comprehensive understanding of the exemplaryembodiments. Accordingly, it is apparent that the exemplary embodimentscan be carried out without those specifically defined matters. Also,well-known functions or constructions are not described in detailbecause they would obscure the exemplary embodiments with unnecessarydetail.

FIG. 1 is a block diagram of an example of a basic constitution of auser terminal device in order to explain various exemplary embodiments.The user terminal device 1000 of FIG. 1 may be implemented as varioustypes of devices such as a television (TV), a personal computer (PC), alaptop PC, a cellular phone, a tablet PC, a personal digital assistant(PDA), an MP3 player, a kiosk, an electronic frame, or a table display.When the user terminal device 1000 is implemented as a type of devicethat can be carried by a user, such as a cellular phone, a tablet PC, aPDA, an MP3 player, or a laptop PC, it may be referred to as a mobiledevice. However, exemplary embodiments will be explained below byreferring to such a mobile device as a ‘user terminal device’.

Referring to FIG. 1, the user terminal device 1000 includes a bendedtouch screen 100 and a controller 200.

The bended touch screen 100 is divided into a main area and one or moresub areas. The dimensional size of the sub areas may be smaller than thedimensional size of the main area. Further, one or more sub areas mayform different surfaces from that of the main area. For example, whenthe main area is arranged on the front surface of the user terminaldevice 1000, one or more sub areas may be arranged on different surfacessuch as a right side surface, a left side surface, and a back surfaceamong the surfaces constituting the exterior body of the user terminaldevice 1000. The surface including the main area (which may be a planaror curved surface) and the surface including one or more sub areas(which may be planar or curved surfaces) may be fixed in place to forman obtuse angle with respect to the exterior surfaces of the userterminal device 1000. Put another way, the bended touch screen 100 isdivided into a main surface and one or more side surfaces. The format(i.e., form or shape), position, or number of the sub areas may beimplemented variously according to exemplary embodiments. The above willbe explained in greater detail below with reference to the drawings.

The controller 200 may separately control the main area and one or moresub areas of the bended touch screen 100. For example, contents whichare different from each other may be respectively displayed on the mainarea and the one or more sub areas. The type, display method, and layoutof contents displayed on the main area and one or more sub areas may bemodified variously according to exemplary embodiments. The above will beexplained in greater detail below.

FIG. 2 illustrates an example of a constitution of the exterior body ofthe user terminal device 1000 including the bended touch screen 100which is divided into one sub area and main area.

Referring to FIG. 2, the bended touch screen 100 may be divided intomain area 1010 arranged on the front surface of the user terminal device1000 and sub area 1020 arranged on the right side surface of the userterminal device 1000. In FIG. 2, the main area 1010 and the sub area1020 may be divided based on boundary area 1050. Considering that thebended touch screen 100 is bent, the boundary area 1050 may bedifferently referred to as a bending line.

FIG. 3 illustrates an example of a surface constitution of the userterminal device 1000 of FIG. 2. Referring to FIG. 3, the main area 1010and the sub area 1020 of the bended touch screen 100 are respectivelyarranged on the front surface and the right side surface of the userterminal device 1000.

FIGS. 4 and 5 illustrate examples of a constitution of the exterior bodyof the user terminal device 1000 including the bended touch screen 100which is divided into two sub areas and one main area and examples of aconstitution of their respective surfaces.

Referring to FIG. 4, the main area 1010 is arranged on the frontsurface, and the sub areas 1020, 1030 are respectively arranged on theright side surface and the left side surface of the user terminal device1000. The main area 1010 and the sub areas 1020, 1030 are divided byboundary areas 1050-1, 1050-2, respectively.

FIG. 5 illustrates a surface constitution of the user terminal device1000 in FIG. 4. Referring to FIG. 5, each of the sub areas 1020, 1030may be arranged to form obtuse angle with the main area 1010 such thatthe sub areas may be viewed from the front surface direction.

FIGS. 6 and 7 illustrate other examples of the user terminal device 1000including the bended touch screen 100 which is divided into two subareas and one main area. Referring to FIG. 6, the two sub areas 1020,1030 may be respectively arranged on both side surfaces of the main area1010 and fixed in place to form an angle in order to be viewed from theright side and left side directions. Thus, referring to FIG. 7, each ofthe sub areas 1020, 1030 may be bent by an angle closer to 90° from thesurface including the main area 1010.

According to another exemplary embodiment, the one or more sub areas maybe arranged on the surface opposite to that of the main area 1010.

FIGS. 8 and 9 illustrate other examples of the user terminal device 1000including the bended touch screen which is divided into two sub areasand one main area. Referring to FIGS. 8 and 9, the bended touch screen100 is divided into the main area 1010, the first sub area 1020 arrangedon the side surface, and the second sub area 1030 arranged on the backsurface of the user terminal device 1000. In FIG. 9, the second sub area1030 may be arranged on a part of the back surface without covering allof the back surface. The controller 200 may divide the main area 1010,the first sub area 1020, and the second sub area 1030 based on the firstboundary area 1050-1 and the third boundary area 1050-3, respectively,and display different contents in each area.

Meanwhile, although FIGS. 3 to 9 illustrate that the sub areas 1020,1030 are bent in a round format, the sub areas 1020, 1030, may also beconstituted in a planer format. In this case, the planar surfaceincluding the main area 1010 and the planer surface including the subareas 1020, 1030 may be bent according to the boundary lines. Thus, theboundary areas 1050-1, 1050-2, 1050-3 may be in a line format.

Meanwhile, the surface constitution of user terminal device 1000 mayinclude a triangular format (not illustrated). In this case, the surfaceincluding the main area 1010 and the surface including the sub area 1020are connected and constituted to form obtuse angle θ on the boundaryarea 1050. Further, the surface constitution may be constituted invarious other forms such as a trapezoid or pentagonal shape, but is notlimited thereto.

Further, the above illustrates that the bended touch screen 100 is benttoward a horizontal direction based on the front surface of the userterminal device; however, it is not limited thereto. Thus, the bendedtouch screen 100 may also be bent toward a vertical direction based onthe front surface of the user terminal device 1000.

FIG. 10 illustrates that the bended touch screen 100 is bent toward avertical direction. Specifically, the bended touch screen 100 may bedivided into the main area 1010 arranged on the front surface of theuser terminal device 1000 and the sub area 1020 arranged on the lowersurface. A speaker 390 may be arranged on the upper side of the mainarea 1010.

Meanwhile, although FIG. 1 illustrates the constitution of the userterminal device 1000 including the bended touch screen 100 and thecontroller 200, the user terminal device 1000 may further includevarious other elements according to exemplary embodiments. For example,the user terminal device 1000 may further include a storage (i.e., amemory) storing various applications. The controller 200 may displaycontents provided from the application on the main area and the subareas by executing an application stored in the storage according touser gestures. In this specification, the contents displayed on the mainarea are referred to as main contents, and the contents displayed on thesub areas as referred to as sub contents. Further, for convenientexplanation, the main contents provided from a first application arereferred to as first main contents, the sub contents provided from thefirst application are referred to as first sub contents, the maincontents provided from a second application are referred to as secondmain contents, and the sub contents provided from the second applicationare referred to as second sub contents.

The controller 200 may display the main contents and the sub contents indifferent layouts with respect to each other. When an application ismodified, the controller 200 may respectively display the main contentsand the sub contents according to the modified application on the mainarea and the sub areas.

FIG. 11 is a block diagram of an example of a detailed constitution ofthe user terminal device 1000 which is implemented as cellular phone.Referring to FIG. 11, the user terminal device 1000 includes the bendedtouch screen 100, the controller 200, a storage 310, GPS chip 320, acommunicator 330, a video processor 340, an audio processor 350, abutton 360, a microphone 370, a camera 380, the speaker 390, and amotion sensor 400.

The bended touch screen 100 may be divided into the main area and one ormore sub areas as described above. The bended touch screen 100 may beimplemented as various types of displays such as an LCD (liquid crystaldisplay), an OLED (organic light emitting diodes) display, and a PDP(plasma display panel). The bended touch screen 100 may include drivingcircuits that can be implemented as, for example, a-si TFT, LTPS (lowtemperature polysilicon) TFT, and OTFT (organic TFT), and backlightunits. Further, the bended touch screen 100 may be implemented as aflexible display. The bended touch screen 100 may be also implemented asnormal display that is not flexible. When the bended touch screen 100 isimplemented as normal display, a plurality of displays may be connectedto constitute the bended touch screen 100.

Meanwhile, the bended touch screen 100 may include a touch sensor tosense touch gestures of a user. The touch sensor may be implemented asvarious types of sensors such as a capacitive type, a resistive type, ora piezoelectric type. The capacitive type calculates touch coordinatevalues by sensing micro-electricity, excited by the user's body, withcoated conductive materials on the surface of the touch screen when apart of the user's body (e.g., the user's finger) touches the surface ofthe touch screen. According to the resistive type, the touch screenincludes two electrode plates and calculates touch coordinate values bysensing electric current that flows upon contacting of the upper and thelower plates on the touched point when a user touches the screen.Furthermore, when the user terminal device 1000 supports a pen inputtingfunction, the bended touch screen 100 may sense user gestures to useinputting means such as pen in addition to the user finger. When theinputting means is a stylus pen including coils, the user terminaldevice 1000 may include a magnetic sensor (not illustrated) to sensemagnetic fields which change according to the proximity of the coilswithin the stylus pen to the magnetic sensor. Thereby, in addition tosensing touch gestures, the user terminal device 1000 may also senseapproaching gestures, i.e., hovering of the stylus pen above the userterminal device 1000.

The storage 310 may store various programs and data necessary foroperation of the user terminal device 1000. For example, the storage 310may store programs and data to constitute various screens to bedisplayed on the main area and the sub areas.

The controller 200 displays contents on the main area and the sub areaof the bended touch screen 100 by using the stored programs and data inthe storage 310. Further, the controller 200 may perform a controllingoperation corresponding to a user touch performed on the main area, thesub area, or the boundary area corresponding to the boundary between themain area and the sub area.

The controller 200 includes RAM 210, ROM 220, CPU 230, GPU (graphicprocessing unit) 240, and a bus 250. The RAM 210, the ROM 220, the CPU230, and the GPU 240 may be connected with each other through the bus250.

The CPU 230 accesses the storage 310 and performs booting using theoperating system (OS) stored in the storage 310. Further, the CPU 230performs various operations by using the various programs, contents, anddata stored in the storage 310.

The ROM 220 stores command sets for system booting. When a turn-oncommand is inputted and electrical power is provided, the CPU 230 copiesthe OS stored in the storage 310 to the RAM 210 according to the commandsets stored in ROM 220, and boots the system by executing the OS. Whenbooting completes, the CPU 230 copies the various programs stored in thestorage 310 to the RAM 210, and performs various operations by executingthe copied programs in the RAM 210. When booting of the user terminaldevice 1000 completes, the GPU 240 displays a user interface (UI) screenon an activated area among the main area and the sub area. Specifically,the GPU 240 may generate a screen including various objects such asicons, images, and texts by using a calculator (not illustrated) and arenderer (not illustrated). The calculator calculates feature valuessuch as coordinate values, formats, sizes, and colors in which objectsare respectively marked according to the layout of the screen. Therenderer generates various layouts of screens including the objectsbased on the calculated feature values in the calculator. The screensgenerated in the renderer are provided to the bended touch screen 100,and respectively displayed on the main area and the sub areas.

GPS chip 320 is unit which receives GPS signals from a GPS (globalpositioning system) satellite, and calculates current position of theuser terminal device 1000. The controller 200 may calculate the user'sposition by using GPS chip 320 when the navigation program is used orwhen current position of a user is requested.

The communicator 330 is unit which performs communication with varioustypes of external devices according to various types of communicationmethods. The communicator 330 includes WiFi chip 331, Bluetooth chip332, wireless communication chip 333, and NFC chip 334. The controller200 performs communication with various external devices by using thecommunicator 330.

The WiFi chip 331 and the Bluetooth chip 332 respectively performcommunication according to a WiFi method and a Bluetooth method. Whenthe WiFi chip 331 or the Bluetooth chip 332 is used, various connectinginformation such as a service set identifier (SSID) and a session keymay be first trans-received, communication may be connected by using theconnecting information, and various information may be trans-received.The wireless communication chip 333 is a chip which performscommunication according to various communication standards such as IEEE,Zigbee, 3G (3^(rd) generation), 3GPP (3^(rd) generation partnershipproject), and LTE (long term evolution). The NFC chip 334 is a chipwhich operates according to a NFC (near field communication) methodusing 13.56 MHz bandwidth among various RF-ID frequency bandwidths suchas 135 kHz, 13.56 MHz, 433 MHz, 860˜960 MHz, and 2.45 GHz.

The video processor 340 is unit which processes video data included inthe contents received through the communicator 330 or the contentsstored in the storage 310. The video processor 340 may perform variousimage processing such as decoding, scaling, noise filtering, frame rateconverting, and resolution converting regarding video data.

The audio processor 350 is unit which processes audio data included inthe contents received through the communicator 330 or the contentsstored in the storage 310. The audio processor 350 may perform variousprocessing such as decoding, amplifying, and noise filtering regardingaudio data.

The controller 200 may reproduce corresponding contents by driving thevideo processor 340 and the audio processor 350 when the reproducingprogram is executed for multimedia contents.

The bended touch screen 100 may display the image frames generated inthe video processor 340 on one or more of the main area and the subareas.

Further, the speaker 390 outputs the audio data generated in the audioprocessor 350.

The button 360 may be various types of buttons such as a mechanicalbutton, or a touch pad, or touch wheel which is formed on some area likethe front surface, the side surface, or the back surface of the mainexterior body of the user terminal device 1000.

The microphone 370 is unit which receives user voices or other soundsand converts them into audio data. The controller 200 may use theinputted user voices through the microphone 370 during the callingprocess, or convert them into the audio data and store in the storage310.

The camera 380 is unit which captures still images or video imagesaccording to controlling of a user. The camera 380 may be implemented asplural units such as front surface camera and back surface camera. Asdescribed below, the camera 380 may be used as means to obtain userimages in the exemplary embodiment of tracking the gaze of a user.

When the camera 380 and the microphone 370 are provided, the controller200 may perform controlling operations according to user voices inputtedthrough the microphone 370 or user motion recognized by the camera 380.Thus, the user terminal device 1000 may operate in a motion controllingmode or a voice controlling mode. When operating in the motioncontrolling mode, the controller 200 photographs a user by activatingthe camera 380, tracks changes in the user's motion, and performs acorresponding operation. When operating in the voice controlling mode,the controller 200 may operate in voice recognizing mode to analyze uservoices inputted through the microphone 370 and perform a controllingoperation according to the analyzed user voices.

In the user terminal device 1000 supporting the motion controlling modeor the voice controlling mode, voice recognizing technologies or motionrecognizing technologies may be used in the above various exemplaryembodiments. For example, when a user performs a motion like selectingan object marked on a home screen, or speaks a voice commandcorresponding to an object, it may be determined that the correspondingobject is selected, and the controlling operation matched with theobject may be performed.

The motion sensor 400 is unit which senses movement of the main body ofthe user terminal device 1000. The user terminal device 1000 may rotateor tilt in various directions. The motion sensor 400 may sense movementfeatures such as rotating direction, angle, and gradient by using one ormore of various sensors such as a geomagnetic sensor, a gyro sensor, andan acceleration sensor.

Further, although not illustrated in FIG. 11, the user terminal device1000 may also include a USB port that can be connected with a USBconnector, various external inputting ports so as to connect variousexternal components like a headset, a mouse, a LAN, and a DMB chip toreceive and process DMB (digital multimedia broadcasting) signals, andvarious other sensors according to exemplary embodiments.

As described above, the storage 310 may store various programs. FIG. 12is a diagram provided to explain a software structure stored in the userterminal device 1000. Referring to FIG. 12, the storage 310 may storesoftware including OS 1210, kernel 1220, middleware 1230 and application1240.

The operating system (OS) 1210 performs functions of controlling andmanaging general operations of the hardware. Thus, the OS 1210 performsbasic functions such as hardware management, memory, and security.

The kernel 1220 plays a pathway role which delivers various signalsincluding touch signals sensed in the bended touch screen 100 to themiddleware 1230.

The middleware 1230 includes various software modules to controloperation of the user terminal device 1000. Referring to FIG. 12, themiddleware 1230 includes X11 module 1230-1, APP manager 1230-2,connecting manager 1230-3, security module 1230-4, system manager1230-5, multimedia framework 1230-6, main UI framework 1230-7, windowmanager 1230-8, and sub UI framework module 1230-9.

The X11 module 1230-1 is module which receives various event signalsfrom various hardware provided in the user terminal device 1000. Herein,events may be variously established and may include, for example, anevent in which user gestures are sensed, an event in which a systemalarm occurs, and an event in which specific program executes orcompletes.

The APP manager 1230-2 is module which manages executing situation ofvarious applications 1240 installed in the storage 310. The APP manager1230-2 calls and executes an application corresponding to an event whenthe event to execute the application is sensed by the X11 module 1230-1.

The connecting manager 1230-3 is module which supports wire or wirelessnetwork connections. The connecting manager 1230-3 may include variousdetailed modules such as a DNET module and a UPnP module.

The security module 1230-4 is module which supports certification,request permission, and secure storage regarding the hardware.

The system manager 1230-5 monitors the situation of each unit within theuser terminal device 1000 and provides the monitoring results to theother modules. For example, if a battery has a low charge, an erroroccurs, or a communication connection is cut, the system manager 1230-5may output informing messages or alarm sounds by providing themonitoring results to the main UI framework 1230-7 or the sub UIframework 1230-9.

The multimedia framework 1230-6 is module which reproduces multimediacontents stored in the user terminal device 1000 or provided fromexternal sources. The multimedia framework 1230-6 may include a playermodule, a camcorder module, and a sound processing module. Thereby, itmay perform reproducing of various multimedia contents, and generatingand reproducing screens and sounds.

The main UI framework 1230-7 is module which provides various UIs to bedisplayed on the main area of the bended touch screen 100, and the subUI framework 1230-9 is module which provides various UIs to be displayedon the sub areas of the bended touch screen 100. The main UI framework1230-7 and the sub UI framework 1230-9 may include an image compositormodule comprising various objects, a coordinate compositor to calculatecoordinate values with which objects will be marked, a rendering moduleto render the constituted object on the calculated coordinate value, andtwo-dimensional/three-dimensional (2D/3D) UI toolkit to provide toolswhich constitutes a 2D or 3D format of UI.

The window manager 1230-8 may sense a touch event from the user's body,the pen, or other inputting events. The window manager 1230-8 maydeliver event signals to the main UI framework 1230-7 or the sub UIframework 1230-9 when such event is sensed, and perform the operationcorresponding to the event.

Furthermore, various other program modules may be stored in the storage310. For example, a writing module to draw lines according to draggingtracks when a user touches or drags the screen, and an angle calculatingmodule to calculate pitch angle, roll angle, and yaw angle based on thevalues sensed by the motion sensor 400, may be stored in the storage310.

The application module 1240 includes applications 1240-1˜1240-n tosupport various functions. For example, it may include program modulessuch as a navigation program module, a game module, an electronic bookmodule, a calendar module, and an alarm managing module, to providevarious services. Such applications may be established by default, orvoluntarily established and used by a user. When an object is selected,the CPU 230 may execute an application corresponding to the selectedobject by using the application module 1240.

The software structure illustrated in FIG. 12 is merely an exemplaryembodiment and is not limited thereto. Thus, units may be deleted ormodified, or new units may be added. For example, various programs maybe additionally provided. For example, a sensing module to analyzesignals sensed by various sensors, a messaging module such as messengerprogram, an SMS (short message service) & MMS (multimedia messageservice) program, an e-mail program, a call info aggregator programmodule, a VoIP module, and a web browser module, may be additionallyprovided.

Meanwhile, as described above, the user terminal device 1000 may beimplemented as various types of devices such as a cellular phone, atablet PC, a laptop PC, a PDA, an MP3 player, an electronic framedevice, a TV, a PC, and a kiosk. Thus, the constitutions described inFIGS. 11 and 12 may be variously modified according to the type of theuser terminal device 1000.

As described above, the user terminal device 1000 may be implemented asvarious formats and constitutions. The controller 200 of the userterminal device 1000 may support various user interactions according toexemplary embodiments.

The following will explain a user interaction method according tovarious exemplary embodiments.

According to an exemplary embodiment, the controller 200 may receivesignals requesting execution of an application installed in the userterminal device 1000. For example, when data is received from anexternal device, when a user requests execution of an application byusing the button 360 or the bended touch screen 100 provided on the mainbody of the user terminal device 1000, or when an application has beenset to automatically execute at a certain previously determined time,the controller 200 may receive signals requesting execution of theapplication.

The controller 200 may selectively display an application in one of afirst layout or a second layout in response to receiving the signalsrequested execution of the application. In this process, the firstlayout refers to a display layout of the sub area on the bended touchscreen 100, and the second layout refers to a display layout of the mainarea on the bended touch screen 100. When current status of the userterminal device 1000 is displaying the first layout, the controller 200may display an application in the first layout on the sub area of thebended touch screen 100. An application may be displayed on the whole ofthe sub area or a part of the sub area. Further, an application may bedisplayed on both of the main area and the sub area, or a part of theexecuting application may be displayed only on the sub area.

FIGS. 13 and 14 illustrate examples of various layouts. Although FIGS.13 and 14 illustrate the user terminal device 1000 in which the bendedtouch screen 100 is divided into one main area 1010 and one sub area1020, and the sub area 1020 is curved, the bended touch screen 100 maybe implemented as various formats as explained in FIGS. 2 to 10. FIGS.13 and 14 may be uniformly applied to various formats of the userterminal device 1000. Further, for convenient explanation, the followingvarious exemplary embodiments use drawing reference numeral 1010 for themain area, and drawing reference numerals 1020 and 1030 for the subareas.

Referring to FIG. 13, the sub area 1020 of the bended touch screen 100displays a screen in the first layout 1340, and the main area 1010displays a screen in the second layout 1330. Herein, layout refers toinformation to establish size, shape, arrangement position, andarrangement order regarding areas to display various other information.

Referring to FIG. 13, the first layout 1340 is divided into a pluralityof areas 1341, 1342, 1343. Further, the second layout 1330 is dividedinto a plurality of areas 1331, 1332, 1333, 1334. For example, one ormore of information among icons, buttons, menus, virtual keyboards,objects, or contents may be included in each of the areas 1341, 1342,1343, 1331, 1332, 1333, 1334.

Further, the screen size of the first layout 1340 may be smaller thanthe screen size of the second layout 1330. The horizontal length 1345 ofthe screen in the first layout 1340 may be smaller than the horizontallength 1335 of the screen in the second layout 1330, and the verticallength 1346 of the screen in the first layout 1340 may be uniform orsimilar to the vertical length 1336 of the screen in the second layout1330. Further, the ratio between the horizontal length 1345 and thevertical length 1346 of the screen in the first layout 1340 is smallerthan the ratio between the horizontal length 1335 and the verticallength 1336 of the screen in the second layout 1330.

FIG. 14 illustrates an example of a third layout. As described above,the third layout refers to a layout corresponding to all of the mainarea 1010 and the sub area 1020.

Referring to FIG. 14, the third layout 1400 on the bended touch screen100 may correspond to the whole display area including the main area1010 and the sub area 1020; however, it is not limited thereto. Thus,the third layout 1400 may correspond to the display area including apart of the main area 1010 and a part of the sub area 1020. The thirdlayout 1400 may include a plurality of areas 1401˜1407. Some areas 1403,1407 may be displayed across both the main area 1010 and the sub area1020. Further, size of the third layout 1400 may be greater than size ofthe first layout 1340 and size of the second layout 1330.

The controller 200 may display information by selectively applyinglayouts based on various conditions such as a situation or action of auser or surrounding circumstances. Further, the displayed informationmay be differently determined according to such conditions. When signalsrequesting displaying of an application installed in the user terminaldevice 1000 are received, the controller 200 may selectively display theapplication in the first layout or the second layout in response to thesignal. For example, when an application should be displayed on the mainarea, the controller 200 displays the application in the second layouton the main area. When an application should be displayed on the subarea, the controller 200 displays the application in the first layout onthe sub area.

Further, when an application should be displayed by using the whole areaof the main area and the sub area in terms of the application features,or when the third layout corresponding to all of the main area and thesub area on the bended touch screen 100 is selected, the controller 200displays the application according to the third layout on all of themain area and the sub area.

According to an exemplary embodiment, the controller 200 may displayvarious information on the sub area by considering a current location ofa user, a current surrounding environment of a user, and a current time.When the user terminal device 1000 includes the constitution of FIG. 11,the controller 200 may confirm the current location from the GPS chip320, and determine the surrounding environment of the user terminaldevice 1000 by comparing the current location with prestored mapinformation. For example, when the user terminal device 1000 is locatedat a shopping center or a department store, the controller 200 maydetermine that a user is shopping. Similarly, when the user terminaldevice 1000 is located at an amusement park or a movie theater, thecontroller 200 may determine that a user is going to ride an amusementride or watch a movie. According to the determining results, thecontroller 200 may provide valuable information to the user.

For example, when a user is shopping, the controller 200 may providealarm information related with the shopping through the sub area in realtime. The alarm information related with the shopping may includemessages such as “Time limited sale begins in 5 minutes.”

As another example, when a user is playing at an amusement park, thecontroller 200 may provide alarm information related with the amusementpark through the sub area in real time. The alarm information relatedwith the amusement park may include messages such as “You have 5 minutesuntil loading of the reserved roller coaster.”

As another example, when a user is watching a movie, alarm informationrelated with the movie may be provided on the sub area at real time. Theinformation related with the movie may include messages such as “Youhave a reserved ticket; AAAA movie, 13 hall, 24:30.”

In order to provide various alarm information, as in the above examples,the controller 200 may perform communication with a server managed by acorresponding location or building. For example, when a user carryingthe user terminal device 1000 enters a shopping center, the controller200 accesses the server corresponding to the shopping center through thecommunicator 330. Thereby, various information related with the shoppingmay be received from the server. The controller 200 may output some ofthe received information in the message format as described above.Further, when a user carrying the user terminal device stands at anamusement park or within a movie theater like, as the above examples,the controller 200 may receive various information which is valuable toa user by performing communication with a server corresponding to thelocation, and provide the information through the sub area.

Meanwhile, as another example, when the user terminal device 1000transmits or receives data by connecting with surrounded devices, thecontroller 200 may display various information related with thecorresponding communication through the sub area. For example, one ormore of connecting information, a connecting situation, transmittingresults or receiving results may be displayed on the sub area.

The connecting information may include a list of surrounded devices thatcan be connected with the user terminal device 1000. The connectingsituation may be displayed in animation format. For example, the subarea may display an animation indicating that the user terminal device1000 is connecting with the surrounded devices or animation that anobject is moving from a device transmitting data to a device receivingdata. Further, when transmitting successfully completes or fails, orwhen receiving successfully completes or fails, the controller 200 maydisplay the result message on the sub area.

According to another exemplary embodiment, the controller 200 maydisplay various information on the sub area by considering a currentuser action.

For example, when a user taps on the table or speaks specific soundswhile the user terminal device 1000 is placed on the table, thecontroller 200 may execute a previously determined application anddisplay the execution screen on the sub area.

As another example, when a user opens a purse that the user terminaldevice 1000 is being carried in, the controller 200 may activate the subarea so that the user terminal device 1000 or other items within thepurse can be easily seen, and messages, images, screens, or previouslydetermined applications may be displayed. As another example, when auser is exercising, the controller 200 may display exercising results(e.g., exercising time, exercising distance, and consumed calories) orinformation regarding the exercising on the sub area.

Further, when there is an application already being executed on the mainarea, the controller 200 may determine that a user is currently workingon the main area and display another application which additionallyexecuted according to the first layout on the sub area.

Therefore, a user may receive feedback regarding their actions moresimply and conveniently by using the sub area. Further, alarminformation of several random push services can be displayed in a lumpon the sub area. Thus, a user may keep working on the main area whilereceiving information (e.g., the alarm information) on the sub area.

The controller 200 may determine current situation of the user terminaldevice 1000 or user actions by using one or more sensors (notillustrated) included in the user terminal device 1000, the motionsensor 400, the microphone 370, or the camera 380 of FIG. 11.

For example, in the above exemplary embodiments, the controller 200 maydetermine whether a user taps on the table or speaks specific sounds byusing the microphone 370 of FIG. 11.

Further, if the brightness of an image captured by the camera 380 isless than a preset brightness value, or if a separately providedillumination sensor (not illustrated) senses that illumination less thana preset value, it may be determined that a purse carrying the userterminal device 1000 is being opened when preset features of audiosignals, such as those generated by the opening of a zipper or button onthe purse, are inputted through the microphone 370. Further, when themotion sensor 400 senses that the user terminal device 1000 moves in aspecific pattern, the controller 200 may determine that a user isexercising, and calculate exercising results or information regardingthe exercising by using the exercising time and distance.

Furthermore, the controller 200 may determine whether a user's gaze isdirected toward the main area or the sub area based on the sensingresults of the motion sensor 400, the camera 380, and the touch sensor(not illustrated). For example, when an acceleration sensor included inthe motion sensor 400 senses that the sub area of the user terminaldevice 1000 tilts toward a user, the camera 380 captures an image inwhich the user's gaze is directed toward the sub area, and when theuser's grip of the user terminal device 1000, determined based on thetouch position sensed on the bended touch screen 100, matches with thegrip of a user viewing the sub area, the controller 200 may determinethat the user is viewing the sub area.

Further, the controller 200 may determine whether at least part of themain area is covered by a cover of the user terminal device 1000 orother objects by using the illumination sensor or the distance sensor.Further, the controller 200 may determine whether a user is standing inpublic place by using the GPS chip 320, the illumination sensor (notillustrated), or the camera 380. The controller 200 may also determinewhether there is necessity to reduce electrical power consumption of theuser terminal device 1000 by using a measuring sensor (not illustrated)for determining the amount of charge left in the battery of the userterminal device 1000. The following will explain various examples ofdetermining a current situation of the user terminal device 1000 inexemplary embodiments to be described below.

The controller 200 may display the application being executed on the subarea or the main area of the bended touch screen 100 by considering acurrent situation of the user terminal device 1000. When the currentsituation of the user terminal device 1000 is displaying the firstlayout, the controller 200 may display an application on the sub area ofthe bended touch screen 100. When current situation of the user terminaldevice 1000 is displaying the second layout, the controller 200 maydisplay an application on the main area of the bended touch screen 100in the second layout. When current situation of the user terminal device1000 is displaying the third layout, the controller 200 may display anapplication on all of the main area and the sub area of the bended touchscreen 100 in the third layout.

The controller 200 may selectively determine the first to the thirdlayouts according to various conditions such as a preset setting of auser, features of applications, a current using environment of the userterminal device 1000, and actions of the user.

FIGS. 15 to 19 are diagrams explaining exemplary embodiments fordisplaying information based on a user's gaze.

In FIGS. 15 to 19, the controller 200 may analyze whether a user's gazeis directed toward the main area 1010, the sub area 1020, or both of themain area and the sub area of the bended touch screen 100 by using oneor more sensors included in the user terminal device 1000 or the camera380. The controller 200 may display applications on the main user gazearea according to analyzing results of the user's gaze.

For example, when a user is tilting the user terminal device 1000horizontally or vertically, the controller 200 may determine a tiltingangle of the user terminal device 1000 by using the acceleration sensor(not illustrated), and whether the user's gaze is directed toward themain area or the sub area.

Further, the controller 200 may sense the user's face, some area of theuser's face (e.g., T area between both eyes and the nose), or the eyeposition of the user by using the camera 380, and determine whether theuser's gaze is directed toward the main area or the sub area.

Further, the controller 200 may measure a size of an area touched by afinger of the user or measure pressure changes on the main area or thesub area in order to determine the user's grip of the user terminaldevice 1000, and determine whether the user's gaze is directed towardthe main area or the sub area according to the measuring results. Thenormal grip of a user when viewing the main area is different from thenormal grip of a user when viewing the sub area. Therefore, informationregarding a touched position, a touched size, and a touched pressuremeasured in each of the gripping positions of the user terminal device1000 is matched with a grip of a user when viewing each of the differentarea of the bended touch screen and stored in the storage 310. Thecontroller 200 may analyze whether a current grip of a user matches withthe information stored in the storage 310, and determine whether theuser's gaze is directed toward the main area or the sub area. Methods ofdetermining a user's gaze may be implemented using various exemplaryembodiments within a technical scope of the exemplary embodiments forthose skilled in the art.

Referring to 1510 of FIG. 15, contents (e.g., video contents) may bereproduced on the main area of the bended touch screen 100. In 1510 ofFIG. 15, a user may tilt the user terminal device 1000 by a certainangle (θ1) toward the user. For example, θ1 may be 0°˜30°. According tothe user action, as in 1520 of FIG. 15, the user's gaze may be directedtoward all of the main area 1010 and the sub area 1020. While contentsare displayed on the main area 1010, the controller 200 may display anapplication 1521 to control corresponding contents on the sub area 1020.The application 1521 may provide a menu to control the contentsdisplayed on the main area 1010. For example, the user may performfunctions of stop, pause, skip, quick play, and slow play regarding thecontents displayed on the main area 1010 by using the menu.

Meanwhile, a user may tilt the user terminal device 1000 by a certainangle (θ2) toward the user. For example, θ2 may be 80°˜100°. 1530 ofFIG. 15 illustrates that the user terminal device 1000 tilts by θ2.

According to the user action, the gaze of the user may be directedtoward the sub area in 1530 of FIG. 15. Thereby, when the gaze of theuser is directed toward the sub area 1020, the controller 200 maydisplay an application 1531 to provide a list of contents, that can bereproduced on the main area 1010, on the sub area 1020. The user mayselect one contents from the contents list, and convert the currentlyreproduced contents on the main area 1020 into the selected contents.

Meanwhile, according to another exemplary embodiment, the controller 200may differently determine information marking a position of the user'sgaze. FIG. 16 is a diagram provided to explain such an exemplaryembodiment.

Referring to 1610 of FIG. 16, contents 1611 (e.g., video contents) maybe reproduced on the main area 1010 of the bended touch screen 100. Likethe situation in 1510 of FIG. 15, the user's gaze is directed toward themain area 1010. In this situation, when new messages arrive or programupdating event occurs, the controller 200 may display alarm informationon the sub area 1020 to inform the user of the events. 1610 of FIG. 16illustrates that the alarm information 1612 indicating that a newmessage has arrived is displayed on the sub area 1020.

As illustrated in FIG. 16, when the main area 1010 and the sub area 1020are connected with each other while forming an obtuse angle, a user mayeasily recognize alarm information displayed on the sub area 1020, evenwhen they are viewing the main area 1010. the user may recognize thealarm information 1612 and tilt the user terminal device 1000 by acertain angle (θ3) toward the user. For example, θ3 may be variousangles such as 0°˜30°.

When the user terminal device 1000 tilts toward the front, the user'sgaze may be directed toward all of the main area and the sub area, asillustrated in 1620 of FIG. 16. Thereafter, the controller 200 maydisplay detailed information 1621, 1622 of the alarm information 1612 onsome area in the sub area 1020 and the main area 1010.

In 1620 of FIG. 16, the information 1621 regarding a third party sendinga message may be displayed on the sub area 1020, the messagedescriptions 1622 received from the third party and the informationregarding the third party 1623 may be displayed on some of the main area1010. When a user further tilts the user terminal device 1000 toward thefront, or maintains the tilting position, the detailed information 1621,1622 may be expanded gradually and displayed toward the lower part ofthe main area 1010.

Although FIG. 16 illustrates that the main area 1010 and the sub area1020 meets by forming an obtuse angle, the operation according to suchexemplary embodiment may be uniformly performed in the user terminaldevice 1000 including the bended touch screen 100 in which the main areaand the sub area meets by forming the right angle.

FIG. 17 illustrates a situation when the user terminal device 1000 istilted by an angle more than that of FIG. 16 (i.e., θ3). Referring to1710 of FIG. 17, reproduced contents 1711 may be displayed on the mainarea 1010 of the bended touch screen 100. When a message arrives from anexternal device, alarm information 1712 indicating that a new messagehas arrived may be displayed on the sub area 1020 of the bended touchscreen 100. A user may recognize the alarm information 1712 and tilt theuser terminal device 1000 by a certain angle (θ4). For example, θ4 maybe 80°˜100°. In 1720 of FIG. 17, the user's gaze may be directed towardthe sub area 1020 according to the user action. Thereafter, thecontroller 200 may display detailed information 1721, 1722, 1723 of thealarm information 1712 on the sub area 1020. For example, one or more ofinformation regarding a sender 1721, the message descriptions 1722, andthe contents 1723 added to the message may be displayed in ticker formaton the sub area 1020.

As set forth above, a user may grip the user terminal device 1000 withvarious grips and tilt the user terminal device 1000 in variousdirections. The user terminal device 1000 may display screens on one ormore of the main area and the sub area by considering the grip of theuser, and a tilting direction and tilting degree of the user terminaldevice 1000. Further, in addition to displaying the screens, resolution,brightness, contrast, and color regarding each of the main area and thesub area may also be modified.

Referring to 1810 of FIG. 18, a first application and a secondapplication may be respectively displayed on the main area and the subarea of the bended touch screen 100. 1810 of FIG. 18 illustrates that auser grips the user terminal device 1000 with the right hand, and viewsthe main area 1010. In this situation, as illustrated in 1810 of FIG.18, a user may rotate the user terminal device 1000 by θ5 with respectto the Z axis. For example, θ5 may be 0°˜50°.

As illustrated in 1820 of FIG. 18, when the user terminal device 1000rotates, the user's gaze may be directed toward all of the main area1010 and the sub area 1020. In this case, the controller 200 maydetermine that the user's gaze moves from the main area 1010 to the subarea 1020, and modify display features of the main area 1010. Forexample, the controller 200 may adjust the brightness of screen on themain area to be darkened or the resolution of the screen to be lower.

The user may further rotate the user terminal device 1000 by θ6 in theabove situation. For example, θ6 may be 50°˜100°. 1830 of FIG. 18illustrates that the user terminal device 1000 rotates further by θ6.The user's gaze may then be directed primarily toward the sub area 1020,as in 1830 of FIG. 18. In this case, the controller 200 may determinethat the user's gaze is directed toward the sub area and continueadjusting the brightness of the screen on the main area 1010. Forexample, the controller 200 may further darken brightness of the screenon the main area 1010 or convert the screen on the main area 1010 intooff status.

According to another exemplary embodiment, the sub area and the mainarea may be interlocked with each other according to rotating of theuser terminal device 1000. For example, referring to 1910 of FIG. 19, afirst application may be displayed on the main area 1010 of the bendedtouch screen 100. In 1920 of FIG. 19, when the user terminal device 1000receives a message, the controller 200 may display alarm information1921 on the sub area 1020 of the bended touch screen 100 indicating thata new message has arrived. A user may recognize receiving the alarminformation 1921 and rotate the user terminal device 1000 by a certainangle (θ7) with respect to the Z axis. For example, θ7 may be 0°˜30°.

According to the user rotating action, the controller 200 may furtherprovide the alarm information 1921 and additional alarm information1931, 1932, as illustrated in 1930 of FIG. 19. Each of the alarminformation 1921, 1931, 1932 may be visually distinguished and displayedaccording to features of the alarm information or receivers.

The user may further rotate the user terminal device 1000 by a certainangle (θ8). For example, θ8 may be 80°˜100°. When being rotated likethis, the controller 200 may expand and display detailed information1941, 1942, 1943 of the alarm information 1921, 1931, 1932 on the mainarea 1010 as illustrated in 1940 of FIG. 19. For example, when the alarminformation 1921, 1931, 1932 include some descriptions of the messages,the detailed information 1941, 1942, 1943 may include whole descriptionsof the messages. The detailed information 1941, 1942, 1943 may bevisually distinguished and displayed in different colors from eachother. Meanwhile, as a rotating angle of the user terminal device 1000increases, descriptions of the detailed information 1941, 1942, 1943displayed on the main area 1010 may increase.

The user terminal device 1000 may display an application on the mainarea and the sub area according to various other exemplary embodiments.FIG. 20 is a diagram which an application is displayed on the sub areaby considering user gestures in the user terminal device 1000 accordingto another exemplary embodiment.

Referring to 2010 of FIG. 20, alarm information 2011 (e.g., a message)may be displayed on the main area 1010 of the bended touch screen 100.In 2020 of FIG. 20, a user may perform gesture (e.g., dragging gesturesor flicking gestures) 2021 and move the alarm information 2011 displayedon the main area 1010 to the sub area 1020. In 2030 of FIG. 20, thecontroller 200 may display an application related with the alarminformation 2011 on the sub area in response to the user gesture 2021.The controller 200 may perform a function related with the alarminformation 2011 by using the application displayed on the sub area1020. For example, the controller 200 may display detailed descriptionsof the alarm information 2011 by using the application displayed on thesub area 1020, store the alarm information 2011, or retransmit the alarminformation 2011.

FIGS. 21 to 23 are diagrams explaining exemplary embodiments fordisplaying an application on the sub area by considering the surroundingenvironment.

In FIGS. 21 to 23, the controller 200 may determine the surroundingenvironment of the user terminal device 1000 by using one or moresensors (not illustrated) provided in the user terminal device 1000. Forexample, the controller 200 may determine illumination surrounding theuser terminal device 1000 by using the illumination sensor. Further, thecontroller 200 may determine a place where the user terminal device 1000operates by using the GPS chip 320 or other position sensors. Further,the controller 200 may determine whether one or more objects standwithin a certain distance of the user terminal device 1000 by using thedistance sensor. Further, the controller 200 may determine illuminationsurrounding the user terminal device 1000, a place where the userterminal device 1000 operates, or whether one or more objects standwithin a certain distance of the user terminal device 1000 by using thecamera 380. The controller 200 may determine the surrounding environmentof a user, whether the user terminal device 1000 is covered by the coverof the user terminal device 1000 or other objects, carried within apurse, or placed at a public place (e.g., in a theater or a meetingroom). Methods of determining the surrounding environment of a user maynot be limited to the above exemplary embodiments and those skilled inthe art can implement various exemplary embodiments within a technicalscope of the exemplary embodiments.

Referring to 2110 of FIG. 21, when an event to display an applicationoccurs, the controller 200 may determine whether the main area of thebended touch screen 100 is covered by the cover 10 of the user terminaldevice 1000 or other objects. Herein, the event to display anapplication may be various events such as an event of receiving messagesor emails from external devices, an event of receiving signals torequest displaying of a specific application from external devices, anevent of receiving user gestures to execute a specific application anddisplay the executing screen, an event in which the preset time periodapproaches, and event in which an update version regarding theapplications stored in the user terminal device 1000 is generated. 2110of FIG. 21 illustrates the exemplary embodiment in which the eventoccurs while the cover 10 covers the user terminal device 1000.

When the main area of the bended touch screen 100 is covered with thecover 10 of the user terminal device 1000 or other objects, thecontroller 200 may display an application in the first layout on the subarea 1020, as illustrated in 2120 of FIG. 21. In 2120 of FIG. 21, theapplication to display a new message is displayed in layoutcorresponding to the sub area 1020.

Further, when a part of the main area 1020 regarding the bended touchscreen 100 is covered by the cover 10 of the user terminal device 1000or other objects, the user terminal device 1000 may display anapplication on one or more area among the areas of the main area 1010which are not covered and the sub area 1020.

FIG. 22 illustrates an exemplary embodiment which the user terminaldevice 1000 is carried within a purse. Referring to 2210 of FIG. 22,when the above described event occurs, the controller 200 may display anapplication by using a part of the main area 1010 or the sub area 1020.For example, the controller 200 may receive alarm information to requestdisplaying the application to provide information from external devices.In this case, the controller 200 may confirm the surrounding situationof the user terminal device 1000, determine whether a user intends toconfirm the alarm information or not, and display the applicationaccording to the determined result. In 2210 of FIG. 22, when the userdoes not open the purse 20, the controller 200 may determine that theuser does not intend to confirm the alarm information, and may keep thescreens of the main area and the sub area in off state. Meanwhile, asillustrated in 2220 of FIG. 22, when the user opens the purse 20, thecontroller 200 may determine that the user intends to confirm the alarminformation, and may display the application to provide the alarminformation in the first layout on the sub area 1020. In order todetermine whether the user opens the purse 20 or not, the controller 200may use the illumination sensor, the distance sensor, and the camera 380provided in the user terminal device 1000. Specific determining methodsare already explained in the above and will not be further explained.

FIG. 23 is a diagram provided to explain another exemplary embodiment ofan operation to provide different displays according to surroundingenvironment. Referring to 2310 of FIG. 23, while the user terminaldevice 1000 is located at public places (e.g., in a theater), thecontroller 200 may receive signals requesting displaying of anapplication. For example, the controller 200 may receive alarminformation to requesting displaying of the application to provideinformation (e.g., call arriving information). The controller 200 maydetermine whether the user terminal device 1000 operates at publicplaces or not by using the illumination sensor or the camera 380provided in the user terminal device 1000. Specifically, whenillumination sensed by the illumination sensor is less than a certainlevel, and images photographed by the camera 380 include a theater logo,movie title, and an audience, the controller 200 may recognize thecurrent position to be a public place. Further, when a user converts thecall arriving mode of the user terminal device 1000 from a sound mode tothe soundless or vibrating mode, the controller 200 may determine theplace where the user terminal device 1000 operates to be public place.Further, the controller may determine whether the place is public or notbased on position information sensed by the GPS chip 320.

In 2320 of FIG. 23, when it is determined that the user terminal device1000 is positioned at a public place, the controller 200 may display theapplication to provide alarm information 2321 in the first layout on thesub area 1020. The brightness of the sub area 1020 may be adjustedaccording to the illumination of the surrounding environment. Forexample, the brightness of the sub area 1020 may be displayed with alower level if illumination of the surrounding environment is low.Meanwhile, the controller 200 may inactivate the main area 1010.

In this situation, the controller 200 may perform a controllingoperation corresponding to user gestures performed on the sub area 1020.

For example, in 2330 of FIG. 23, when an application is displayed on thesub area, a user may reject the arriving call related with the alarminformation 2321 by performing user gesture (e.g., dragging gestures orflicking gestures) 2331 toward a first direction. Further, the user mayreceive the arriving call by performing user gesture (e.g., dragginggestures or flicking gestures) 2331 toward a second direction differentfrom the first direction on the sub area 1020. 2340 of FIG. 23illustrates the situation when the controller 200 rejects the arrivingcall. According to 2340 of FIG. 23, the controller 200 may display anobject 2341 on the sub area 1020 indicating that the arriving call hasbeen rejected, in response to the user gesture 2331 rejecting thearriving call.

Therefore, a user may reduce inconvenience to other people due to thelights of the screen of the user terminal device 1000 in public placessuch as a dark movie theater. Thus, because size of the screen regardingthe sub area is smaller than size of the main area, it may minimizeinconvenience to the other people by minimizing the screen lights orleakage of information displayed on the screen.

According to another exemplary embodiment, displaying may be performedby considering electrical power of the user terminal device 1000.

FIG. 24 is a diagram provided to explain an operation of the userterminal device 1000 according to an exemplary embodiment. FIG. 24illustrates operation of the user terminal device 1000 which displays anapplication on the sub area 1020 of the bended touch screen 100 byconsidering the electrical power situation. Referring to 2410 of FIG.24, the controller 200 may measure the amount of charge remaining in thebattery when an event to display an application occurs. Types of eventsare explained in the above and will not be further described. Thecontroller 200 may determine whether the amount of charge remaining inthe battery is less than a predetermined value (e.g., 20% of wholebattery amount). When the amount of charge remaining in the battery isless than a predetermined value, the controller 200 may display anapplication by using the sub area 1020.

When the amount of charge remaining in the battery is less than apredetermined value, 2420 of FIGS. 24 to 2450 of FIG. 24 illustratevarious examples of an application displayed in the first layout on thesub area 1020. In 2420 of FIG. 24, when signals requesting displaying ofthe voice recognizing application are received from a user, thecontroller 200 may display the voice recognizing application 2421 in thefirst layout on the sub area 1020. Further, in 2430 of FIG. 24, whensignals requesting displaying of the radio application are received froma user, the controller 200 may display the radio application 2431 in thefirst layout on the sub area 1020. Further, in 2440 of FIG. 24, whensignals requesting displaying of the recording application are receivedfrom a user, the controller 200 may display the recording application2441 in the first layout on the sub area 1020. Further, in 2450 of FIG.24, when signals requesting displaying of the payment application arereceived from a user, the controller 200 may display the paymentapplication 2451 in the first layout on the sub area 1020.

Further, when the amount of charge remaining in the battery is less thana predetermined value, the controller 200 may display alarm informationwhich is displayed on the main area 1010 (e.g., call arrivinginformation and message arriving information) on the sub area 1020.

As described above, when the controller 200 displays an application onthe sub area 1020 by considering the amount of charge remaining in thebattery, battery consumption of the user terminal device 1000 may bereduced.

In addition, the user terminal device 1000 may display an application onthe sub area by considering various current situations as well as theamount of charge remaining in the battery. For example, if batterycharging is difficult when a user is taking a trip, the controller 200may display the application to perform searching or finding roads (e.g.,navigation) on the sub area 1020. In this case, when the user terminaldevice 1000 can provide voice recognizing, performing results ofsearching or finding the roads with the voice recognizing can bedisplayed on the sub area 1020.

Further, the controller 200 may display the application on the sub areaby considering the type of the executed application. For example, whenthe application is application to provide simple information such asalarm information, time information, battery information, networkconnecting information, and mode situation information of the userterminal device 1000, the controller 200 may display the application onthe sub area 1020 by considering the type of the executed application.Meanwhile, regarding web browser screens requesting more than a certainsize of the screen, map screens or video screens, the controller 200 maydisplay the screens on the main area 1010.

FIGS. 25 to 27 are diagrams explaining exemplary embodiments fordisplaying an application on the sub area 1020 by considering a securitysituation of the user terminal device 1000.

In FIGS. 25 to 26, the controller 200 may determine whether the userterminal device 1000 needs a security function. For example, when a userexecutes a payment application, or performs the mobile paying functionby using NFC (near field communication) or barcode, the controller 200may determine that security is needed for current situation of the userterminal device 1000.

Referring to 2510 of FIG. 25, when a user performs mobile payment to payfares of the public transportation, the controller 200 may determine thecurrent status of the user terminal device 1000 to request the security.When the fares of the public transportation is paid in 2520 of FIG. 25,the controller 200 may display a message 2521 indicating the approvedpayment and a balance provided from the payment application on the subarea 1020. During this process, the screen of the main area 1010 may beturned off or display information irrelevant to the payment application.For example, when a user performs a mobile payment while viewingmultimedia contents, the multimedia contents may continue to bedisplayed on the main area 1010, and the above described message 2521may be displayed on the sub area 1020.

FIG. 26 illustrates an example of when a user purchases goods by usingan electronic wallet application at a market or shopping mall. Referringto 2610 of FIG. 26, when the user executes the electronic walletapplication at a market, the controller 200 may determine the currentstatus of the user terminal device 1000 to request the security. Whenthe electronic wallet application is executed in 2620 of FIG. 26, thecontroller 200 may display card information 2621 provided from theelectronic wallet application on the sub area 1020.

As another example, if there are coupons that a user can use whenperforming mobile payment, the controller 200 may display couponinformation on the sub area 1020. FIG. 27 illustrates that barcode 2231of the coupon is displayed on the sub area 1020. The coupon image or alist of the other coupons that can be used may be displayed on the mainarea 1010. Thereby, a user may minimize leakage risk of paymentinformation toward a third party by using the sub area 1020 to displaythe payment information.

Meanwhile, although the above describes the exemplary embodiments inwhich various screens are displayed on one or more of the main area 1010and the sub area 1020 based on the user situation and the surroundingenvironment of the user terminal device 1000, the screens may beimplemented to be displayed based on user intentions.

FIGS. 28 and 29 are diagrams explaining an exemplary embodiment todisplay an application on the sub area by considering user intentions.

In FIGS. 28 and 29, the controller 200 may display an application on thesub area 1020 by considering user intentions. For example, a user mayrequest that battery consumption of the user terminal device 1000 bereduced. Further, the user may request the sub area 1020 to maintain anon state and request to use the user terminal device 1000 as table-setdisplay device. Further, if the current user environment makes itdifficult to use the main area 1010, a user may passively establish theexecuting application to be displayed only on the sub area 1020.

For example, when a user selects an application to execute, thecontroller 200 may display pop-up window to receive a user selectionindicating whether an application is to be displayed on the main area1010 or the sub area 1020 of the bended touch screen 100. The user mayselect a button to display on the sub area 1020 in the pop-up window.When the button is selected, the controller 200 displays the executedapplication on the sub area 1020. Further, if it is sensed that a userperforms specific gestures when executing an application, the controller200 may display the executing application on the sub area 1020.

For example, when a user directly touches an icon corresponding to anapplication for executing the application and simultaneously touches thesub area 1020 with another finger, the controller 200 may execute theapplication, and display the executing application on the sub area 1020.Further, a user may designate an application to be displayed on the subarea 1020 from the application list by using environment setting menu orseparate menu.

Methods of displaying an application on the sub area 1020 according touser intentions are not limited to the above examples and those skilledin the art may implement various other exemplary embodiments within thetechnical scope of the exemplary embodiments.

FIG. 28 is a diagram provided to explain a method in which a userestablishes an application to be displayed on the sub area. When theuser selects a menu for environment setting, the controller 200 maydisplay the environment setting menu 2811 including various menus thatcan be established as illustrated in 2810 of FIG. 28. The user mayselect sub area display setting menu 2812 on the environment settingmenu 2811 of the user terminal device 1000. Although FIG. 28 illustratesthat the sub area display setting menu 2811 is included in theenvironment setting menu 2811, it is not limited thereto. Thus,according to another exemplary embodiment, the sub area display settingmenu 2812 may be entered by using an application other than theenvironment setting menu 2811.

When a user selects the sub area display setting menu 2812, thecontroller 200 displays the screen in which various applications to bedisplayed on the sub area 1020 can be selected, as illustrated in 2820of FIG. 28. In 2820 of FIG. 28, the user may select one or more ofapplications 2821, 2822, 2823 to be displayed on the sub area 1020 whenbeing executed. FIG. 28 illustrates that the translating application2821, the news application 2822, and the searching application 2823 areselected.

The user may select various objects such as icons or texts from thescreen displayed on the main area 1010 in 2830 of FIG. 28, and execute aspecific application 2831. During this process, the controller 200 maydetermine whether the application 2831 is designated to be displayed onthe sub area 1020. According to the determined result, when theapplication 2831 is designated to be displayed on the sub area 1020, thecontroller 200 may execute and display the application 2831 on the subarea 1020, as illustrated in 2840 of FIG. 28. For example, the sub area1020 may display news information, alarm information, or weatherinformation while being scrolled toward a certain direction.

Further, when the user terminal device 1000 operates as table-setdisplay device, the sub area 1020 displaying the application may keepdisplaying the application without entering the screen-off state untilanother user input is performed.

For example, when the previously designated application is thetranslation application 2821, dialogue descriptions with a foreigner maybe automatically translated and displayed on the sub area 1020.Accordingly, a user may have talks with a foreigner using anotherlanguage while the user terminal device 1000 is placed on a table.

Meanwhile, according to another exemplary embodiment, the user terminaldevice 1000 may display alarm information on the sub area by consideringits priority order. FIG. 29 is a diagram provided to explain anexemplary embodiment which displays an application on the sub area 1020by considering the priority order of alarm information. The controller200 may receive various alarm information from external devices. Thealarm information may have a certain priority order according to a usersetting or predetermined standard. For example, information with highimportance such as a call or text message may have high priority, andinformation with low importance such as advertising, local informationor SNS information may have low priority. In this case, alarminformation with high priority may be displayed on the main area 1010,and alarm information with low priority may be displayed on the sub area1020. Referring to 2910 of FIG. 29, the controller 200 may display thereceived alarm information 2911 on the sub area 1020. During thisprocess, the displayed application 2912 may be continued to be displayedon the main area 1010.

2920 of FIG. 29 illustrates that two alarm information 2911, 2921 aredisplayed on the sub area 1020. A user may select one of the alarminformation 2911, 2921 which are being displayed on the sub area 1020.For example, a user may touch and drag the alarm information 2911 fromthe sub area 1020 to the main area 1010 to select it. In this case, thecontroller 200 may display detailed information of the selected alarminformation 2911 on the main area 1010. 2930 of FIG. 29 illustrates thatthe detailed information 2931 of the selected alarm information 2911 isdisplayed on the main area 1010.

For example, when the alarm information 2911 is information indicatingthat a coupon has arrived, the detailed information 2931 displayed onthe main area 1010 may include one or more from places and times wherethe coupon can be used, and a button 2932 for viewing the coupon image.The user may select the button 2932 in order to view the coupon image.2940 of FIG. 29 illustrates that the user selects the button 2932. Inthis case, the controller 200 may provide the coupon image 2941 on themain area 1010. The coupon image 2941 may include a receive button 2942and a cancel button 2943, as well as detailed information regarding thecoupon. The user may select the receive button 2942 if they want toreceive the coupon. In this case, the controller 200 may providebenefits corresponding to the coupon to the user. For example, if it isfree gift coupon, the controller 200 may expand and display theeffective number or the barcode to receive free gift so that a thirdparty can recognize the coupon through a POS (point of sales) device.Further, if it is discount coupon, the controller 200 may calculate thepayment price by applying the corresponding discount rate to thediscount coupon, and process the electronic payment. Further, thecontroller 200 may provide various other services according to types ofcoupons.

According to the various exemplary embodiments as described above, theuser terminal device 1000 may display various screens by using the mainarea 1010 and the sub area 1020. Specifically, various applications oralarm information may be displayed on the sub area 1020. Meanwhile, asdescribed above, the sub area 1020 may be implemented to be more thanone area, and connected with the main area 1010 by various angles. Thus,the three-dimensional interaction screen may be displayed by using thesub area 1020.

The following will explain exemplary embodiments which can display athree-dimensional interaction screen.

According to another exemplary embodiment, the controller 200 of theuser terminal device 1000 may receive signals requesting displaying ofthe screen constituted with a plurality of pages or a plurality oflayers. Herein, a plurality of layers refers to virtual display screenswhich are consecutively integrated, and a plurality of pages refers tounits of screens which are horizontally connected on one layer. Forexample, one layer may include a plurality of pages. Signals to requestdisplaying the screen constituted with a plurality of pages or aplurality of layers may be signals generated by a user pushing a homebutton or unlocking the screen in the lock screen situation. Thecontroller 200 may display main contents of the contents provided fromthe application on the main area 1010 and sub contents of the contentson the sub area 1020, in response to the requesting signals. The subcontents may be contents related with the main contents, and objectsindicating one side of the main contents so that the main contents canbe displayed dimensionally. Thus, one three-dimensional interactionscreen may be generated by combining the main contents and the subcontents.

FIG. 30 is a diagram of the screen constituted with a plurality oflayers according to an exemplary embodiment.

The screen constituted with a plurality of layers may be displayed onthe main area 1010 and the sub areas 1020, 1030 of the bended touchscreen. Referring to FIG. 30, contents provided by widget or directicons may be displayed on the main area 1010 of the screen constitutedwith a plurality of layers. For convenient explanation, the exemplaryembodiment uses the same drawing reference numerals as those illustratedin the above other exemplary embodiments.

The sub areas 1020, 1030 may include the first sub area 1020 displayingan object illustrating that contents included in the first layer among aplurality of layers are piled up, and the second sub area 1030displaying an object illustrating that a plurality of layers are piledup. Although FIG. 30 illustrates that both sides of the main area 1010connects to the two sub areas 1020, 1030, number and position of the subareas may be variously modified according to size, type, and features ofthe user terminal device 1000, as described above. According to anotherexemplary embodiment, only one sub area among the first sub area 1020and the second sub area 1030 may be provided.

Referring to FIG. 30, the main area 1010 may display one or more fromthe main contents 3015˜3019 included in the first layer among aplurality of layers and the direct icons 3011˜3014.

A plurality of layers may be divided per category according to types ofcontents respectively provided from a plurality of layers. For example,a plurality of layers may be divided into a contextual category, a mediacontents category, an SNS category, and a ‘my favorite category.’ Thecontextual category may provide event preview images based on images.The media contents category may provide dynamic images that can bedirectly controlled by a user. The SNS category may phase providinginformation, optimize to the information area, and provide theinformation. The ‘my favorite category’ may provide widgets that a userrequests, frequently used applications, or the call function.

The main contents 3015˜3019 may be provided by widgets included in thefirst layer. The main contents may be updated at real time; for example,weather, messages, SNS, memos or pictures may be information. When themain contents are plural, the main area 1010 may display that aplurality of main contents 3015˜3019 is piled up. For example, the mainarea 1010 may simultaneously display at least part of each of theplurality of main contents 3015˜3019. The important content 3015 amongthe main contents 3015˜3019 may be separately displayed to a user so asto be distinguished from the other contents 3016˜3019. When the userperforms gestures to select and twist the important content 3015, theimportant content 3015 may be modified so as to be visuallydistinguished from the other contents 3016˜3019. For example, asillustrated in FIG. 30, the controller 200 may rotate the importantcontent 3015 by a certain angle and display.

The direct icons 3011˜3014 may be arranged and displayed on a part ofthe main area 1010. In this case, when the user selects one icon amongthe direct icons 3011˜3014, and performs gestures to expand size of theicon (e.g., pinch gestures or spread gestures), a widget may beautomatically generated according to the expanded size. Further, themain contents provided by the generated widget may be displayed on allof the main area 1010.

Further, referring to 3110 of FIG. 31, the second sub area 1030 mayinclude one or more of a status area 3021, a category index area 3022,and a running app area 3023. The status area 3021 is area informing ofthe current status of the user terminal device 1000; for example,information regarding the amount of charge remaining in the battery andcurrent time may be included. The category index area 3022 may displayobjects 3022-1˜3022-5 illustrating that a plurality of layers are piledup.

Referring to the category index area 3022 of FIG. 30, it is clearlyillustrated that 5 layers in total are consecutively piled on the mainarea 1010. The objects 3022-1˜3022-5 respectively corresponding to aplurality of layers may be expressed in different colors from eachother. Among the objects 3022-1˜3022-5 respectively corresponding to aplurality of layers, the object 3022-5 corresponding to the first layerwhich is currently displayed on the main area 1010 may be highlightedand displayed. The running app area 3023 may display the objects 3023-1,3023-2, 3023-3 illustrating that currently executing applications arepiled up. The application displayed on the main area 1010 may behighlighted and displayed. The running app area 3023 may be providedonly when there is executing application, and the objects correspondingto the executing application on the background may not be displayed onthe running app area 3023.

Referring to FIG. 30, the first sub area 1020 may display sub contents3031˜3037 related with main contents 3015˜3019 which are displayed onthe main area 1010. For example, when the main content 3017 is providedthrough a widget included in the first layout, the first sub area 1020may display the objects 3035˜3037 illustrating that contents that can beprovided from the widget are piled up. Meanwhile, the first sub area1020 may respectively display the first objects 3031˜3034 provided fromthe first widget among a plurality of widgets and the second objects3035˜3037 provided from the second widget among a plurality of widgets.The first objects 3031˜3034 and the second objects 3035˜3037 may beadjacent and displayed.

For example, as illustrated in FIG. 30, the first objects 3031˜3034 andthe second objects 3035˜3037 may be parted by a certain interval.Further, although not illustrated in FIG. 30, a marked distinguishingline may be included between the first objects 3031˜3034 and the secondobjects 3035˜3037.

FIG. 31 illustrates interaction screens viewed by a user from differentdirections. 3110 of FIG. 31 illustrates one example of the interactionscreen constituted with 5 layers 3061˜3065. When the user's gaze isdirected toward the user terminal device 1000, the main area 1010 andthe sub areas 1020, 1030 may selectively display one from among objectsshowing side surfaces regarding a plurality of layers 3061˜3065,contents 3071˜3078 included in the plurality of layers 3061˜3065, andobjects showing side surfaces regarding the contents.

In 3110 of FIG. 31, the user's gaze may be directed toward the left sidesurface of the user terminal device 1000. The user may view a pluralityof objects respectively showing side surfaces regarding the plurality oflayers 3061˜3065 through the second sub area 1030. Specifically, asillustrated in FIG. 30, the screen constituted with a plurality of areas3021, 3022, 3023 may be displayed on the second sub area 1030. Further,the user may view contents included in the layer selected by the useramong the plurality of layers 3061˜3065 through the main area 1010.Referring to 3110 of FIG. 31, the layer selected by the user may bedisplayed on the most upper portion so as to be viewable to the user.

3120 of FIG. 31 illustrates the user's gaze directed toward the rightside surface of the user terminal device 1000. In this case, the usermay view a plurality of objects showing side surfaces of contents thatcan be provided by widget included in the layer displayed on the mainarea 1010 through the first sub area 1020. The user may select one fromthe plurality of objects showing side surfaces regarding the pluralityof layers 3061˜3065 displayed on the first sub area 1020. In this case,while the Z axis is expanding based on the layer corresponding to theselected object, objects showing side surfaces of contents 3071˜3078that can be provided by widget included in the corresponding layer maybe displayed, as illustrated in 3120 of FIG. 31. Such objects may beexpressed in various formats 3031˜3037 as illustrated in FIG. 30.

Meanwhile, as described above, a plurality of layers may be respectivelyconstituted with one or more pages. When a plurality of pages areincluded in the currently selected layer, a user may freely navigate aplurality of pages.

FIG. 32 is a diagram provided to explain how a user navigates the screenconstituted with a plurality of pages or a plurality of layers in theuser terminal device 1000 according to an exemplary embodiment.

Referring to 3210 of FIG. 32, the controller 200 consecutivelyintegrates and displays a plurality of layers on the main area 1010.When the first layer is positioned on the most upper portion, thecontroller 200 may display main contents included in a first page 3201among a plurality of pages included in the first layer. The userterminal device 1000 may receive user gesture (e.g., dragging gesturesor flicking gestures) 3211 toward one direction (e.g., d1 or d2) on themain area 1010.

Referring to 3220 of FIG. 32, the controller 200 may display the maincontents included in a second page 3202 among a plurality of pages onthe main area 1010 in response to the user gesture 3211. In 3220 of FIG.32, the user terminal device 1000 may receive a user gesture 3222 toselect one object 3221 among objects respectively corresponding to aplurality of layers displayed on the second sub area 1030. 3220 of FIG.32 illustrates that the user inputs the dragging gesture 3222 bytouching one object 3221 and dragging it in a direction d3.

When the dragging gesture 3222 is inputted, the selected object 3221 maybe highlighted and displayed so as to be visually distinguished from theother objects. The controller 200 may move the object 3221 and thehighlight mark according to the dragging direction toward the main area1010. When touch of the dragging gesture 3222 is lifted off the screenwhile the object 3221 is displayed on the main area 1010, the main area1010 may display main contents of the second layer corresponding to theselected object 3221. The controller 200 may move the second layercorresponding to the selected object 3221 according to the user gesture3222 on the most upper portion among the plurality of layers. Referringto 3230 of FIG. 32, the controller 200 may display the main contentsincluded in the second layer on the main area 1010 in response to theuser gesture 3222.

The user terminal device 1000 may receive input user gesture (e.g.,dragging gestures or flicking gestures) 3231 toward a certain directionon the main area 1010. The controller 200 may display contents includedin a layer prior or posterior to the second layer displayed on the mostupper portion among the plurality of layers according to the directionof the user gesture 3231 on the main area 1010. For example, when theuser gesture 3231 is directed toward the right side as in 3230 of FIG.32, a layer posterior to the second layer, i.e., the third layer placedunder the second layer among the plurality of layers, may be displayedon the main area 1010. Meanwhile, when the user gesture 3231 is directedtoward the left side, a layer prior to the second layer, i.e., a layerplaced above the displayed second layer among the plurality of layers,may be displayed on the main area 1010. When there is no layer above thesecond layer, it may display a layer placed on the most lower layeramong a plurality of layers. In other words, the plurality of layers maybe consecutively displayed in rotating format according to the usergesture 3231.

In 3240 of FIG. 32, the third layer may be displayed on the main area1010 among the plurality of layers in response to the user gesture 3231.The user terminal device 1000 may receive input user gesture (e.g.,tapping gestures) 3241 to select one from among widgets or direct iconsdisplayed on the main area 1010.

In 3250 of FIG. 32, the application (i.e., “App1”) corresponding to theselected widget or icon may be executed and displayed on the main area1010 in response to the user gesture 3241. During this process, object3251, which corresponds to the currently executing application, may bedisplayed on the second sub area 1030. A user interface to control thedisplayed application may be displayed on the first sub area 1020.

FIG. 33 is a diagram of a user modifying information displayed on thesub area according to an exemplary embodiment.

Referring to 3310 of FIG. 33, the second sub area 1030 may include aplurality of areas. For example, the first sub area 1020 may include thestatus area 3314, the category index area 3315, and the running app area3316. The user terminal device 1000 may receive input user gesture 3317touching and dragging the status area 3314 or boundary between thestatus area 3314 and the category index area 3315.

Referring to 3320 of FIG. 33, the status area 3314 of the second subarea 1030 may be expanded in response to the user gesture 3317. Forexample, the controller 200 may expand the status area 3314 to aposition where a user drags and lifts off the touch gesture. As thestatus area 3314 expands, sizes of the category index area 3315 and therunning app area 3316 on the second sub area 1030 may made be relativelysmaller.

The expanded status area 3321 may include more information as comparedto previously displayed information. For example, in addition to currenttime information 3322 and battery remaining amount information 3323displayed on the status area 3314 before being expanded, one or more ofnetwork connecting information 3324, nearfield network connectinginformation 3325, volume information 3326, or brightness information3327 may be further displayed on the expanded status area 3321. Each ofthe information 3322˜3327 may be consecutively displayed as the statusarea 3314 is expanded. The user terminal device 1000 may receive usergesture (e.g., tapping gestures) 3329 selecting one of the objectscorresponding to a plurality of layers displayed on the reduced categoryindex area 3315 of the second sub area 1030.

Referring to 3330 of FIG. 33, the controller 200 may display maincontents included in the second layer corresponding to the selectedobject on the main area 1010 in response to the user gesture 3329.Further, the status area 3331, the category index area 3332 and therunning app area 3333 may return to how they were displayed before beingexpanded and displayed on the second sub area 1030. Thus, while thelayer displayed on the main area 1010 changes, the second sub area 1030may respectively display the status area 3331, the category index area3332, and the running app area 3333 in predetermined sizes.

A user may perform various interactions by using the sub areas 1020,1030. FIGS. 34 and 35 are diagrams explaining a method previewing layersor contents according to another exemplary embodiment.

Referring to 3410 of FIG. 34, the bended touch screen 100 may includethe main area 1010, the first sub area 1020, and the second sub area1030. The main area 1010 displays a plurality of layers and the secondsub area 1030 displays a plurality of objects corresponding to theplurality of layers. The user terminal device 1000 may receive inputuser gesture (e.g., long-tapping gestures) 3414 touching one or more ofthe plurality of objects displayed on the second sub area 1030 for morethan a certain time. For example, the certain time may be more than 1second.

3420 of FIG. 34 is a diagram of an operation of the user terminal device1000 according to the user gesture 3414. Referring to 3420 of FIG. 34,the controller 200 may display preview image 3421 regarding one or morelayers excluding the layer displayed on the main area 1010 in responseto the user gesture 3414. For example, the preview image 3421 may show apart of one or more layers placed under the layer displayed on the mainarea 1010.

Meanwhile, the user terminal device 1000 may receive an input usergesture 3422 (e.g., dragging gestures) by a user touching one or moreobjects among the objects corresponding to a plurality of layersdisplayed on the second sub area 1030, and dragging toward onedirection. 3430 of FIG. 34 is a diagram of operation of the userterminal device 1000 when the dragging gesture 3422 is inputted.Referring to 3430 of FIG. 34, the controller 200 may display previewimage 3431 regarding lower layers while turning one or more layers likea flipbook on the main area 1010 in response to the dragging gesture3422. The number of the layers and the speed at which they are turnedover like a flipbook may be determined according to dragging distanceand speed of the user gesture 3422. Thus, when a relatively longerdistance is quickly dragged, a larger number of layers may be flippedfaster.

Meanwhile, FIG. 35 is a diagram provided to explain an operation whenuser gestures are inputted on the first sub area 1020. Morespecifically, 3510 of FIG. 35 illustrates that various contents providedby the first application are displayed on the main area 1010 and objectscorresponding to the contents of the first application displayed on themain area 1010 are displayed on the first sub area 1020.

Referring to 3510 of FIG. 35, the user terminal device 1000 may receiveinput user gesture (e.g., long-tapping gestures) 3511 by a user touchingone or more contents for more than a certain time among a plurality ofcontents on the first sub area 1020. In 3510 of FIG. 35, the controller200 may display preview image 3521 on the main area 1010 regarding othercontents from the contents provided by the first application in responseto the user gesture 3511. For example, the preview image 3521 may be apart of other contents from the contents displayed on the main area1010. Meanwhile, the user terminal device 1000 may receive input usergesture (e.g., dragging gestures) 3522 by a user touching one or moreamong a plurality of objects displayed on the first sub area 1020 formore than a certain time, and dragging the touch toward one direction.Referring to 3530 of FIG. 35, the controller 200 may display othercontents or preview image 3533 of other contents while turning thecontents displayed on the main area 1010 like a flipbook in response tothe user gesture 3522. The number of contents and the speed at which thecontents are turned over like a flipbook may be determined according tothe dragging distance and speed of the user gesture 3522.

According to another exemplary embodiment, a user may mark contents onthe main area by using the sub area.

FIG. 36 is a diagram provided to explain an operation of the userterminal device 1000 according to such an exemplary embodiment.Referring to 3610 of FIG. 36, the bended touch screen 100 may includethe main area 1010, the first sub area 1020, and the second sub area1030. The main area 1010 may display one or more main contents 3611provided by an application. The first sub area 1020 may display subcontents 3612˜3615 that can be provided by an application. In thisprocess, a user may perform twisting the main content 3611 displayed onthe main area 1010 in order to mark specific contents. For example, theuser may perform gesture (e.g., twisting gestures) 3616 to rotate themain content 3611 by a certain angle in a “d” direction while touchingthe main content 3611.

Referring to 3620 of FIG. 36, the controller 200 may display the maincontent 3611 so as to be visually distinguished from the other contentsin response to the user gesture 3616. In 3620 of FIG. 36, the markedmain content 3611 may be displayed on the main area 1010 while beingrotated by a certain angle. The rotating angle may be uniform to therotating angle of the user gesture; however, it is not limited thereto.For example, when the rotating angle of the user gesture is more than acertain angle, the controller 200 may rotate the main content 3611 by apredetermined angle.

Further, the controller 200 may display the sub content 3612 relatedwith the marked main contents 3611 so as to be visually distinguishedfrom the other sub contents 3614, 3615, 3616. For example, the subcontent 3612 may be displayed in a curved format, a projected format, ora highlighted format so that a user can intuitively recognize the markedsub content. 3620 of FIG. 36 illustrates that the marked sub contents3612 is displayed in a format bolder than the format of the other subcontents 3614, 3615, 3616.

Meanwhile, the user terminal device 1000 may generate or receive newcontents. For example, when a user photographs a picture or receive newcontents from external devices by using the user terminal device 1000,the user terminal device 1000 may generate or receive new contents. 3630of FIG. 36 illustrates that a new content is received. Referring to 3630of FIG. 36, the controller 200 may display new content 3621 overlappedon the marked main contents 3611 displayed on the main area 1010. Inthis case, the sub content 3632 related with the new content 3621 may bedisplayed on the first sub area 1020. Next, the user terminal device1000 may receive user gesture (e.g., tapping gestures) 3634 selectingthe sub content 3612 related with the marked main content 3611 among aplurality of sub contents displayed on the first sub area 1020.

Referring to 3640 of FIG. 36, the controller 200 may display the markedmain content 3611 related with the marked sub content 3612 again on themain area 1010 in response to the user gesture 3634 to select the markedsub content 3612. Thus, when the marked sub content 3612 is displayed soas to be distinguished from the other sub contents on the first sub area1020, a user may quickly display the marked main content 3611 on themain area 1010 by selecting the marked sub content 3612.

FIG. 37 is a diagram provided to explain a method of displaying alarminformation of the user terminal device 1000 according to anotherexemplary embodiment. Referring to 3710 of FIG. 37, the bended touchscreen 100 may include the main area 1010, the first sub area 1020, andthe second sub area 1030. The second sub area 1030 may include thestatus area 3711, the category index area 3712, and the running app area3713. The user terminal device 1000 may receive notification informationor alert information while displaying information on the main area 1010,the first sub area 1020, and the second sub area 1030.

Referring to 3720 of FIG. 37, the controller 200 may display thenotification information or the alert information on the second sub area1030 of the bended touch screen 100 in response to the notificationinformation or the alert information. For example, the status area 3711may display the notification information or the alert informationrelated with the OS of the user terminal device 1000. The running apparea 3713 may display the notification information or the alertinformation regarding the executing application. Further, the categoryindex area 3712 may highlight and display objects related with thenotification information or the alert information among the objectscorresponding to a plurality of layers. 3720 of FIG. 37 illustrates thatthe object 3721 corresponding to the layer including the applicationrelated with the notification information or the alert information ishighlighted and displayed. For example, the object 3721 may be displayedwhile slowly flashing. In this process, the category index area 3712 maydisplay preview information 3722 related with the notificationinformation or the alert information. For example, at least some of thenotification information or the alert information may be automaticallyscrolled toward one direction and displayed on the second sub area 1030.

Meanwhile, when the layer including the application related with thenotification information or the alert information is layer currentlydisplayed on the main area 1010, the controller 200 may display the maincontents or widgets related with an application corresponding with ahighlight on the main area 1010.

Further, the first sub area 1020 may highlight and display the subcontents of the contents related with the corresponding application onthe first sub area 1020. The highlighted main contents or sub contentsmay be slowly flashed and displayed.

Meanwhile, a user may voluntarily select an object on the second subarea 1030. For example, in 3720 of FIG. 37, the user terminal device1000 may receive input user gesture (e.g., tapping gestures) 3723 toselect one object 3721 on the category index area 3712. The user gesture3723 may be performed while the object 3721 is highlighted anddisplayed. The highlight of the object 3721 may be automatically removedafter a certain time.

The controller 200 may display the layer corresponding to the selectedobject 3721 on the main area 1010 in response to the user gesture 3723as illustrated. If there is no object corresponding to the layerincluding the application related with the notification information orthe alert information on the second sub area 1030, when a user selectsthe second sub area 1030 while displaying the notification informationor the alert information, new application 3731 that can control thenotification information or the alert information may be executed anddisplayed on the main area 1010. In this process, a layer correspondingto the newly executing application may be generated, and new object 3732corresponding to the generated layer may be displayed on the second subarea 1030.

Meanwhile, the notification information or the alert information may begenerated or received even when the main screen 1010 and the second subscreen 1030 of the user terminal device 1000 are turned off. In thiscase, the controller 200 may display the position of the applicationrelated with the notification information or the alert information onthe second sub area 1030.

FIG. 38 is a diagram provided to explain an operation of the userterminal device 1000 according to an exemplary embodiment. For example,when an application is executing, the controller 200 may display anobject 3841 corresponding to the application to be highlighted on therunning app area 3813. Further, the controller 200 may display an object3842 corresponding to the layer including the application to behighlighted on the category index area 3812. Herein, highlighting theobjects 3841, 3842 may be implemented to be flashing objects whileslowly fading in or fading out. When the user terminal device 1000receives the notification information or the alert information, thesecond sub area 1030 may display at least part 3843 of the notificationinformation or the alert information. For example, at least part 3843 ofthe notification information or the alert information may be scrolledtoward one direction and displayed on the status area 3811, the categoryindex area 3812, and the running app area 3813 of the second sub area1030.

FIG. 39 is a diagram provided to explain how the user terminal device1000 moves contents or applications into another layer according toanother exemplary embodiment. Referring to 3910 of FIG. 39, the bendedtouch screen 100 may include the main area 1010, the first sub area1020, and the second sub area 1030. The main area 1010 may display themain content 3911 provided by an application. The first sub area 1020may display the sub content 3913 that can be provided by an application.When the main content 3911 is displayed on the main area 1010, the userterminal device 1000 may receive input user gesture (e.g., long-tappinggestures) 3912 touching the main content 3911 and maintaining touchingfor more than a certain time.

Referring to 3920 of FIG. 39, the controller 200 may fix the maincontent 3911 on the main area 1010 in response to the user gesture 3912.For example, the controller 200 may display the selected main content3911 on the main area 1010 as if it is floating. Thus, the main content3911, and the contrast, color, or position of surrounding graphics nearthe main contents 3911 may be modified.

Next, the user terminal device 1000 may receive input user gesture(e.g., flicking gestures) 3921 flicking the objects corresponding to aplurality of layers on the second sub area 1030 while maintaining thetouch. When such user gesture 3921 is inputted, the controller 200 maydisplay contents of the other layers on the main area 1010 while themain content 3911 is fixed on the main area 1010, as illustrated in 3930of FIG. 39. Thus, it may provide the effect as if the main content 3911penetrates through the other layers while being fixed on the main area1010.

When a user finds a layer in which the main content 3911 will bepositioned, the user terminal device 1000 may receive input user gesture(e.g., releasing gestures) 3931 lifting off the touch on the maincontent 3911.

Referring to 3940 of FIG. 39, the main content 3991 may be positioned onthe layer currently displayed on the current main area 1010 in responseto the user gesture 3931. In this process, the first sub area 1020 maydisplay the sub content 3941 related with the main contents 3911together.

Meanwhile, according to another exemplary embodiment, the user terminaldevice 1000 may display weather contents by using the main area and oneor more of the sub areas. FIGS. 40 to 43 illustrate various exemplaryembodiments to display weather contents.

Referring to FIG. 40, the bended touch screen 100 may include the mainarea 1010, the first sub area 1020, and the second sub area 1030. Themain area 1010 may display weather content 4011 which is main contentsprovided by the weather application. For example, the weather content4011 may include one or more from climate icons such as the clouds, thesun, the moon, the rain or the snow, and icons indicating the currenttime.

The first sub area 1020 may display the sub contents 4012˜4014 of theweather application. For example, the sub contents 4012˜4014 may be subcontents corresponding to weather contents per local area. The first subcontent 4012 corresponds to weather contents of a London local areacurrently displayed on the main area 1010, the second sub content 4013corresponds to weather contents of a Seoul local area, and the third subcontent 4014 corresponds to weather contents of a Busan local area.

FIG. 41 is a diagram of weather contents according to another exemplaryembodiment. Referring to FIG. 41, the bended touch screen 100 mayinclude the main area 1010, the first sub area 1020, and the second subarea 1030. The main area 1010 and the second sub area 1030 may displayweather contents provided by the weather application. Herein, theweather contents may be divided and displayed with respect to time. Forexample, the controller 200 may display that the weather changes as thetime goes from the main area 1010 to the first sub area 1020.Specifically, the controller 200 may display an object 4021 indicatingthe weather at current time on the left side or the center of the mainarea 1010, and consecutively display objects indicating changes of theweather as the time goes toward the first sub area 1020 direction.Referring to FIG. 41, the controller 200 may display the object 4021indicating the clear weather on the left side of the main area 1010, anobject 4022 indicating that it gets cloudy while going to the first subarea 1020, and an object 4023 indicating that it is raining on the firstsub area 1020. A user may intuitively recognize that the weather willget cloudy by viewing such a UI.

FIG. 42 is a diagram of weather contents according to another exemplaryembodiment. Referring to FIG. 42, the bended touch screen 100 mayinclude the main area 1010, the first sub area 1020, and the second subarea 1030. The main area 1010 and the first sub area 1020 may displayweather contents provided by the weather application. The main contents4031 regarding the weather contents displayed on the main area 1010 maybe image or video displaying a view as if a user was in the sky lookingtoward the ground or alternatively as if a user was standing on theground looking toward the sky. Further, the sub content 4032 regardingthe weather contents displayed on the first sub area 1020 may be imageor video displaying a view as if a user was standing on the groundlooking toward the horizon. For example, when the weather is raining atcurrent time, the main area 1010 may display image or video showing theclouds, the landscape between the clouds, or the glass ceiling meetingthe falling raindrops. Further, the first sub area 1020 may display alandscape in which the rain is coming to the ground or which livingthings or non-living things are meeting the falling raindrops.

FIG. 43 is a diagram of weather contents according to another exemplaryembodiment. Referring to FIG. 43, the bended touch screen 100 mayinclude the main area 1010, the first sub area 1020, and the second subarea 1030. The main content 4041 regarding the weather contentsdisplayed on the main area 1010 may be image, video, or widget relatedwith the weather of the current time. The first sub area 1020 maydisplay objects 4042˜4044 related with the weather after the currenttime. The objects 4042˜4044 may be piled up in different color codeswith respect to each other and displayed according to the weather typesafter the current time. For example, the clear weather may be displayedin a yellow color code, and the cloudy weather may be displayed in agrey color code. Further, the color code 4042 near to the main area 1010may show the weather near to the current time.

FIGS. 40 to 43 explain that the weather contents are displayed bycombining the main area 1010 and the first sub area 1020 on the rightside; however, according to a modified exemplary embodiment, the secondsub area 1030 on the left side may display the weather contents with themain area 1010. Such modified exemplary embodiments will not be furtherillustrated and explained.

Various contents may be provided through the main area and one or moresub area by executing various applications. FIGS. 44 and 45 are diagramsexplaining an exemplary embodiment of providing various contentsaccording to execution of a gallery application. Referring to 4410 ofFIG. 44, the bended touch screen 100 may include the main area 1010, thefirst sub area 1020, and the second sub area 1030.

The user terminal device 1000 may receive a request to execute thegallery application. The gallery application is program to providevarious contents such as images, videos, or texts which are photographedby a user or received from external devices. When a user selects an iconcorresponding to the gallery application among the icons displayed onthe screen, the controller 200 executes the gallery application. Whenthe gallery application is executed, the first sub area 1020 may displayan object illustrating a film container which refers to a specificfolder among folders provided by the gallery application. The foldersmay store contents which are classified according to one or morestandards among a person, a storing or photographing time, a position,and a user setting.

The first sub area 1020 in 4410 of FIG. 44 may display an object 4412illustrating a film container which indicates a person's folder, ‘Lisa.’The main area 1010 may display contents included in specific folder. Inthis process, the contents may be displayed within the frame area of theobject 4412 illustrating the film. Thus, each contents 4411 may bedisplayed in a film format as if the contents are outputted from thefilm container to the main area 1010. The user terminal device 1000 mayreceive input user gesture (e.g., dragging or flicking gestures) 4413toward one direction on the main area 1010. Further, the user terminaldevice 1000 may receive input user gesture (e.g., dragging or flickinggestures) 4414 toward one direction on the first sub area 1020.

4420 of FIG. 44 illustrates an operation when a user performs thegesture 4413 of touching the main area 1010 and moving the touch towardthe left or right direction. Referring to 4420 of FIG. 44, within thefolder including the contents displayed on the main area 1010, thecontroller 200 may display different contents 4421 on the main area 1010in response to the user gesture 4413 being inputted on the main area1010. In this process, the direction or speed in which the othercontents 4421 are displayed may be determined according to the directionor speed of the user gesture 4413. When the user inputs the dragging orflicking gestures 4413 toward the left side, the controller 200 maydisplay new images 4421 as if they are coming out from the object 4412in a film container shape while moving the images displayed on the mainarea 1010 toward the left side.

4430 of FIG. 44 is a diagram provided to explain an operation when auser inputs the gesture 4414 on the first sub area 1020. Referring to4430 of FIG. 44, the controller 200 may display an object 4431indicating another folder instead of the object 4412 indicating thefolder displayed on the first sub area 1020 in response to the usergesture 4414. In this process, different folders may be selectedaccording to direction and speed of the user gesture 4414. For example,when a user quickly flicks toward the left direction, a folder on aposition corresponding to the speed may be selected among the foldersprevious to the current folder. Meanwhile, when a user slowly flickstoward the right direction, the next folder after the current folder maybe selected.

4430 of FIG. 44 illustrates that the ‘David’ folder is selected insteadof the ‘Lisa’ folder. Thereby, the main area 1010 may newly displaycontents included in the new David folder. FIG. 45 illustrates anotherexample of the method of displaying the gallery application. Referringto 4510 of FIG. 45, the bended touch screen 100 may include the mainarea 1010, the first sub area 1020, and the second sub area 1030. Theuser terminal device 1000 may receive a request to execute the galleryapplication to provide contents. In response to the request to executethe application, the main area 1010 may display contents included in aspecific folder. In this process, the contents may be displayed withinan object 4511 illustrating a flip clock or color cube. The first subarea 1020 may display an object 4514 indicating a person's folder,‘Lisa,’ among the folders provided by the gallery application. In thisprocess, the object 4514 may be displayed in rotating axis or cylindershape format. The user terminal device 1000 may receive input usergesture (e.g., dragging or flicking gestures) 4512 toward one directionon the main area 1010. Further, the user terminal device 1000 mayreceive input user gesture (e.g., dragging or flicking gestures) 4513toward one direction on the first sub area 1020.

4520 of FIG. 45 illustrates operation when the user gesture 4512 isinputted on the main area 1010. Referring to 4520 of FIG. 45, when theuser gesture 4512 is inputted on the main area 1010, the controller 200may display different contents 4521 within the same folder including thecontents displayed on the main area 1010. In this process, the directionor speed in which the other contents 4521 are displayed may bedetermined according to the direction or speed of the user gesture 4512.For example, when a user quickly flicks toward the right direction, thecontents 4521 arranged farther from the currently displayed contents maybe displayed.

4530 of FIG. 45 is a diagram provided to explain an operation when theuser gesture 4513 is inputted on the first sub area 1020. Referring to4530 of FIG. 45, when the user gesture 4513 is inputted on the first subarea 1020, the controller 200 may display an object 4531 indicatinganother folder instead of an object 4514 indicating the folder displayedon the first sub area 1020. Further, the controller 200 may displaycontents 4541 included in another folder, i.e., the David folder, on themain area 1010. In this process, a different folder may be selectedbecause the direction or speed in which the other folders are displayedmay be determined according to the direction or speed of the usergesture 4513.

FIG. 46 is a diagram provided to explain an exemplary embodiment ofdisplaying the music application. Referring to 4610 of FIG. 46, thebended touch screen 100 may include the main area 1010, the first subarea 1020, and the second sub area 1030. The user terminal device 1000may receive a request to execute the music application to provide musiccontents. For example, when a user selects an icon corresponding to themusic application, the controller 200 may determine that the musicapplication is requested to be executed. In response to the request toexecute the application, the controller 200 may display an object 4611including currently reproducing music contents and menu that canmanipulate the music contents on the main area 1010. In this process,the music contents included in the object 4611 may be automaticallyconverted into other music contents as the time goes.

The first sub area 1020 may display an object 4614 including equalizerinformation of the music which is currently reproducing. The userterminal device 1000 may receive input user gesture (e.g., dragging orflicking gestures) 4612 toward one direction on the main area 1010.Further, the user terminal device 1000 may receive input user gesture(e.g., dragging or flicking gestures) 4613 toward one direction on thefirst sub area 1020.

4620 of FIG. 46 is a diagram provided to explain an operation when theuser gesture 4612 is inputted on the main area 1010. Referring to 4620of FIG. 46, when the user gesture 4612 is inputted on the main area1010, the controller 200 may display an object 4621 regarding musiccontents prior or posterior to the music contents displayed on the mainarea 1010. For example, when the user gesture 4612 is performed towardthe right direction, it may display music contents included later (i.e.,later than the currently displayed music contents) on a music listincluding the currently displayed music contents. On the contrary, whenthe user gesture is moving toward the left direction, it may displaymusic contents included earlier (i.e., earlier than the currentlydisplayed music contents) on the music list including the currentlydisplayed music contents. That is to say, the user gesture 4612 cannavigate a music list (i.e., a playlist).

4630 of FIG. 46 illustrates operation when the user gesture 4613 isinputted on the first sub area 1020. Referring to 4630 of FIG. 46, whenthe user gesture 4613 is inputted on the first sub area 1020, thecontroller 200 may modify an equalizer of the music which is currentlyreproducing. For example, 4630 of FIG. 46 illustrates that the equalizerof the currently reproducing music into “Jazz” equalizer 4631.

FIG. 47 is a diagram provided to explain an exemplary embodiment ofdisplaying the clock application. Referring to 4710 of FIG. 47, thebended touch screen 100 may include the main area 1010, the first subarea 1020, and the second sub area 1030. The user terminal device 1000may receive a request to execute the clock application to provide clockcontents.

For example, a user may request executing the clock application byselecting an icon corresponding to the clock application. The controller200 may execute the clock application according to the executingrequest. Further, the user terminal device 1000 may execute the clockapplication on stand-by status as a default. The controller 200 mayexecute the clock application, and display the main contents 4711 in aclock shape on the main area 1010. The clock contents 4711 may indicatethe current time in an analogue or digital clock format.

The first sub area 1020 may display the sub contents 4712 of the clockapplication. When the main contents 4711 is analogue clock, the subcontents 4712 may indicate operating within the interior part of theanalogue clock. As the time goes, the controller 200 may modify anddisplay operating within the interior part of the sub contents 4712together while modifying the time of the clock contents 4711.

The user terminal device 1000 may receive input user gesture (e.g.,dragging or flicking gestures) 4713 toward one direction on the mainarea 1010. Referring to 4720 of FIG. 47, when the user gesture 4713 isinputted on the main area 1010, the controller 200 may modify the clockcontents 4713 displayed on the main area 1010 into clock contents 4721indicating the current time of another local area.

For example, when the main contents 4711 before being modified shows astandard time in Korea, the main contents 4721 after being modified mayshow a standard time in China or Japan instead of Korea. According tothe distance or speed in which the user gesture like dragging orflicking is performed, the local area which will be displayed thereaftermay be differently selected. For example, when a user quickly flicks, itmay display clock contents indicating a time in America or Canada whichare relatively farther from Korea than Japan. When a user slowly flicks,it may display the clock contents indicating a time in Japan or Chinawhich are nearer to Korea (than e.g., America or Canada).

Meanwhile, according to another exemplary embodiment, a home screen maybe displayed in various formats through the main area or the sub area.FIG. 48 is a diagram provided to explain a display method of a homescreen according to another exemplary embodiment. The home screen isscreen displayed after the user terminal device 1000 is turned on andthe system is ready, which displays a screen displaying the functions tostart another application or provide a widget. The home screen may bedifferently named as, for example, a main screen, a basic screen, or aninitial screen; however, for convenience of explanation thisspecification uniformly refers to this screen as the home screen.

Referring to 4810 of FIG. 48, the bended touch screen 100 may includethe main area 1010 and the first sub area 1020. The home screendisplayed on the main area 1010 may respectively display the maincontents provided by widgets corresponding to the applications installedin the user terminal device 1000. For example, the main area 1010 maydisplay weather content 4811 provided by the weather application orgallery content 4812 provided by the gallery widget.

The first sub area 1020 may display one or more sub contents 4813, 4814provided by the widgets. For example, the first sub area 1020 maydisplay the sub contents 4813 provided by the weather widget or the subcontents 4814 provided by the gallery widget. The lower of the main area1010 may provide app dock 4815 that an application list can be viewed.The user terminal device 1000 may receive input user gesture (e.g.,dragging gestures) 4816 to pull up the app dock 4815 toward onedirection.

4820 of FIG. 48 is a diagram provided to explain an operation when theuser gesture 4816 is inputted. Referring to 4820 of FIG. 48, thecontroller 200 may cover a part of the main area 1010 by expanding theapp dock 4815 in response to the user gesture 4816. The app dock 4815may display shortcut icons 4821˜4824 of the applications that a userfrequently uses.

Further, the user terminal device 1000 may receive input user gesture(e.g., flicking gestures) 4817 to spread the app dock 4815 toward onedirection. 4830 of FIG. 48 illustrates an operation when the flickinggesture 4817 is inputted. In 4830 of FIG. 48, the controller 200 mayexpand and display the app dock 4815 to the whole of the main area 1010in response to the user gesture 4817. Thereby, the main area 1010 maydisplay application home 4831. The application home 4831 may display aplurality of icons corresponding to applications that can be executed bya user. The user terminal device 1000 may receive user gesture (e.g.,long-tapping gestures) 4832 selecting one icon among the plurality oficons and maintaining the touching for more than a certain time.

Referring to 4840 of FIG. 48, the controller 200 may execute anapplication corresponding to the selected icon in response to the usergesture 4832. When one application is selected and executed, thecontroller 200 may display a new home screen 4849 including empty areathat widget 4842 provided by the selected application can be displayedwhile closing the application home 4831 displayed on the main area 1010.On the position where a user maintains the touching on the displayedhome screen 4849, the widget 4842 provided by the selected applicationmay be generated. If there is another widget on the position where theuser maintains the touching, the controller 200 may automatically moveand display the widget 4842 to the empty area where another widget isnot displayed. Further, the user may move the widget 4842 to anotherposition on a home screen 4811 by maintaining the touching and dragging.

Next, the user terminal device 1000 may receive input user gesture(e.g., lifting-off gestures) 4843 lifting off the touching. Referring to4850 of FIG. 48, the widget 4842 provided by the selected applicationmay be added to a home screen 4811 displayed on the main area 1010 inresponse to the user lifting-off gesture 4843. In this process, thefirst sub area 1020 may display the sub contents 4851 that can beprovided by the widget 4842. In this situation, a user may spread theapp dock 4815 again. When a user gesture 4816 to spread the app dock4815 toward one direction is inputted again, the controller 200 maydisplay the application home 4831 again as illustrated in 4830 of FIG.48.

A user may go back to the home screen by inputting preset gesturesregarding the application home 4831.

FIG. 49 is a diagram of an exemplary embodiment of closing theapplication home and displaying a home screen. Referring to 4910 of FIG.49, the user terminal device 1000 may receive input user gesture (e.g.,flicking gestures) 4911 to close the application home 4831.

When such gesture 4911 is inputted, the controller 200 may display thehome screen 4811 again on the main area 1010, as illustrated in 4920 ofFIG. 49.

According to another exemplary embodiment, a user may performinteraction by using the sub area, and modify display situation of themain contents displayed on the main area. The following will explain ingreater detail various exemplary embodiments of performing interactionsby using the sub area.

FIG. 50 is a diagram provided to explain a method of displaying anaddress book on the user terminal device 1000 according to anotherexemplary embodiment.

When a user selects an icon or menu displayed on the user terminaldevice 1000, and executes an address book application, the controller200 displays the address book 5011 on the main area 1010 by usingaddress book information stored in the storage 310. In this situation, auser may scroll through the address book 5011 by using the sub area1020. For example, when the user inputs a dragging or flicking gesture5012 toward one direction while touching the sub area 1020, thecontroller 200 scrolls and displays the address book 5011 on the mainarea 1010 according to the direction and speed of the gestures. When oneof the address book information is touched on the main area 1010, thecontroller 200 may connect a phone call by using corresponding addressbook information, or display a screen for writing emails or messageswhich will be transmitted a contact included in the address bookinformation on the main area 1010. Thereby, the user may performmodifying interactions to modify view points of the informationdisplayed on the main area by using the sub area.

FIG. 51 is a diagram provided to explain another method of scrollingthrough the address book information by using the sub area.

Referring to 5110 of FIG. 51, the address book information displayed onthe main area 1010 may be constituted with an index 5111 and information5112 included in the index 5111. The sub area 1020 may display each ofindexes 5113. A user may input a gesture 5114 dragging or flickingtoward one direction after touching the sub area 1020.

5120 of FIG. 51 illustrates an operation when the gesture 5114 touchingthe D index and dragging the touch toward the upper direction isinputted. Referring to 5120 of FIG. 51, the controller 200 displaysinformation 5121 respectively included in the A, B, C indexes betweenthe A index currently displayed on the main area 1010 and the touched Dindex as if the information is consecutively folded, and scroll towardthe illustrated arrow direction. Thereby, as illustrated in 5130 of FIG.51, the main area 1010 displays the address book information 5131included in the D index, and the sub area 1020 displays the D indextouched by a user on the most upper position while displaying the nextindexes positioned lower than the D index. Therefore, a user may performa quick-jumping interaction to jump over or skip a plurality of addressbook information by using the sub area 1020.

According to another exemplary embodiment, while a user may just confirmnecessary information by activating the main area only or the sub areaonly, the user may also activate and use another area if they feel theneed to. FIG. 52 is a diagram provided to explain an operation of theuser terminal device 1000 according to an exemplary embodiment.

Referring to FIG. 52, the user terminal device 1000 includes the bendedtouch screen 100 which is divided into the main area 1010 and the subarea 1020. When a user does not use the user terminal device 1000 for acertain time, or when the user pushes an inactivating button, thecontroller 200 may inactivate the main area 1010 and the sub area 1020.5210 of FIG. 52 illustrates that the user terminal device 1000 isinactivated, and all of the main area 1010 and the sub area 1020 areturned off. In this situation, when the user pushes an activating buttonor inputs preset activating gestures, the controller 200 may convertinto activating status by simultaneously turning on the main area 1010and the sub area 1020. Further, when the user inputs a gesture 5211rubbing the sub area 1020, the controller 200 may convert intoactivating status by only turning on the sub area 1020. 5220 of FIG. 52illustrates that the sub area 1020 is activated.

When a specific application executes, the controller 200 displayscontents provided by the application on the sub area 1020. 5220 of FIG.52 illustrates that the sub area 1020 displays contents 5221 includinginformation regarding the contents reproduced by the music applicationand its control menu, when the music application executes. Within thesub area 1020, current time information 5222 may be displayed togetherwith the contents 5221 of the music application. The controller 200 maydisplay only the current time information 5222 on the sub area 1020 whenthere is no executing application, or various information such as dateinformation, weather information, and battery information on the subarea 1020.

As illustrated in 5220 of FIG. 52, a user may input a gesture 5223dragging or flicking the sub area 1020 again, and modify the subcontents displayed on the sub area 1020.

When the gesture 5223 is inputted, the controller 200 adds weather subcontents 5232 and battery sub contents 5233 while moving the touchedtime information 5222 toward a lower direction according to thedirection of the gestures 5223, as illustrated in 5230 of FIG. 52.Further, the contents 5221 of the music application may be modified intosub contents 5234 in a reduced album shape, or sub contents 5231regarding emails or other messengers may be displayed. In thissituation, when a user touches one sub content 5232 on the sub area 1020and maintains the touch for more than a certain time, the controller 200may display information regarding the touched sub contents on the mainarea 1010.

5240 of FIG. 52 illustrates an operation displaying weather information5241 related with the sub contents 5232 on the main area 1010 while theweather sub contents 5232 is touched. The controller 200 may display theweather information 5241 by activating a sectional area corresponding tothe position of the sub area 1020 where the weather sub contents 5232 isdisplayed without activating whole of the main area 1010. In thissituation, when a user lifts off the touch, the controller 200 deletesthe weather information 5241 displayed on the section of the main area1010, as illustrated in 5250 of FIG. 52.

Meanwhile, a user may select another sub content within the sub area1020. As illustrated in 5250 and 5260 of FIG. 52, when a user touchesthe mail sub contents 5231, new arriving mail information 5261 (e.g.,email information) received by the main application is displayed on thesection of the main area 1010. In this situation, when a user inputsgesture 5262 dragging or flicking toward the main area 1010 whilemaintaining the touch, the controller 200 activates the whole of themain area 1010, and displays mail application screen 5271, asillustrated in 5270 of FIG. 52. The controller 200 displays sub contents5272 corresponding to the mail application screen 5271 on the sub area1020.

Various operations may be mapped with user gestures performed on the subarea 1020. FIG. 53 illustrates an exemplary embodiment of mapping theback function with the dragging or flicking gestures toward the sub area1020.

As illustrated in 5310 of FIG. 53, the user terminal device 1000 maydisplay a first web page 5311 on the main area 1010. The sub area 1020may display the sub contents corresponding to the first web page 5311and various information to inform status of the user terminal device1000.

When a user gesture 5312 dragging or flipping toward one direction onthe sub area 1020 is inputted, the controller 200 performs the backfunction to display a second page 5321, which is a page previous to thatof the first page, as illustrated in 5320 of FIG. 53. When one object5322 is selected among objects displayed on the second page 5321, thecontroller 200 displays the first page 5311 again as illustrated in 5310of FIG. 53. Further, when user gesture 5323 is inputted again on the subarea 1020 while the second page 5321 is displayed, the controller 200displays a third page 5331 which is upper page of the second page, asillustrated in 5330 of FIG. 53. The third page 5331 may display variousobjects including an object 5332 that can be linked to the second page5321. In FIG. 53, the third page 5311 indicates a main screen of aportal web site, the second page 5321 indicates a screen includingvarious information related with the object when one object is selectedwithin the main screen, and the first page 5331 indicates a screen ofdetailed information linked when the information is selected within thesecond page 5321.

When the third page 5331 is the most upper page of a portal web site,i.e., main screen, the controller 200 displays an affordance image 5341as if the third page 5331 is pushed toward the lower on one side of thethird page, and displays a guide 5342 providing a ‘go to the homescreen’ on the sub area 1020, when user gesture 5333 is inputted again.When a user inputs user gesture 5343 on the sub area 1020 again, thecontroller 200 closes the web browser and displays a home screen 5351.

5350 of FIG. 53 illustrates that the home screen 5351 is displayed inresponse to the user gesture 5343. As illustrated in 5340 of FIG. 53,when the user gesture 5343 is performed toward the lower direction, thehome screen 5351 is displayed as if it is sliding down from the upperpart of the screen, and the app dock 5352 is displayed as if it ispulled over from the lower part of the screen when the home screen 5351has completed sliding down. The app dock 5352 is explained in FIG. 48,and will not be further explained.

Meanwhile, the forward function may be mapped to user gestures movingtoward the upper direction on the sub area 1020 of FIG. 53. For example,when a user gesture moving toward the upper direction is inputted whilethe third page 5331 is displayed, the second page 5321 may be displayed,and the first page 5311 may be displayed when the user gesture isinputted again.

Further, although FIG. 53 describes that the web pages are displayedaccording to the executing of the web browser, the same exemplaryembodiment may be executed in the executing screen of other programs.

FIG. 54 is a diagram of another example of objects that can be displayedon the sub area 1020. Referring to FIG. 54, a task switching object 5400may be displayed on the sub area 1020. The task switching object 5400may include a monochrome object 5420 and a technicolor object 5410.

The monochrome object 5420 is used as a using app area providing anapplication which is currently executing or which was recently used, andthe technicolor object 5410 is used as a favorite function areaproviding functions preferred by a user.

FIG. 55 is a diagram provided to explain an operation of the userterminal device 1000 which provides the objects of FIG. 54 according toan exemplary embodiment.

Referring to 5510 of FIG. 55, while some screen 5511 is displayed on themain area 1010, the controller 200 may display the task switching object5400 on the sub area 1020. A user may touch the monochrome object 5420or the technicolor object 5410 among the task switching object 5400.When a user touches the monochrome object 5420, the controller 200expands the area where the monochrome object 5420 is displayed asillustrated in 5520 of FIG. 55. Further, the controller 200 may displayapplication information 5521 corresponding to the touched monochromeobject 5420 on one side of the touched point in the main area 1010. 5520of FIG. 55 illustrates that the information 5521 related to the cameraapplication is displayed.

When a user inputs a gesture 5522 moving the touched point, thecontroller 200 displays application information 5531 corresponding tothe modified touched point, as illustrated in 5530 of FIG. 55. In 5530of FIG. 55, the information 5521 of the camera application is modifiedinto the information 5531 of the gallery application.

When a user inputs a gesture 5532 moving the touched point toward themain area 1010 direction, the controller 200 displays executing screen5541 of the gallery application on the main area 1010, and the subcontents corresponding to the gallery application on the sub area 1020,as illustrated in 5540 of FIG. 55. As described in FIG. 44, 5540 of FIG.55 illustrates that the sub contents are expressed to be objects 5561,5562, 5563 in a film container shape. The controller 200 may display theobjects 5561, 5562, 5563 respectively showing folders which groupvarious contents such as pictures, videos, and texts on the sub area1020, and contents 5551, 5552, 5553 respectively included in the foldersas if they are output from film containers on the main area 1010.

FIG. 56 is a diagram provided to explain another exemplary embodiment ofperforming interactions by using the sub area. Referring to 5610 of FIG.56, the controller 200 may display the monochrome object 5420 and thetechnicolor object 5410 on the sub area 1020 while displaying somescreen 5611 on the main area 1010. When a user inputs a flicking gesture5612 by more than a certain distance or by more than a certain speedafter touching the monochrome object 5420, the controller 200 modifiesthe currently displayed screen 5611 on the main area 1010 into an object5621 in a shape lying down toward the back direction while displayingobjects 5622 corresponding to various tasks as if they are pulled upfrom the lower of the object 5621, as illustrated in 5620 of FIG. 56.

Further, the controller 200 displays a plurality of sub objects 5623,5624 corresponding to the objects 5621, 5622 on the sub area 1020. Theobject displayed on the most upper portion of the screen and the subobjects 5621, 5623 correspond to the screen 5611 displayed before theuser gesture 5612 is inputted. A user may convert the main area intodifferent screens by selecting each of the objects or the sub objects.

As illustrated in 5620 of FIG. 56, when a user touches App 05, thecontroller 200 modifies the color of sub object 5626 which correspondsto App 05, and immediately executes the application corresponding to App05. Thereby, the controller 200 displays an App 05 screen 5631 on themain area 1010, and displays the task switching object 5400 in anoriginal size on the sub area 1020 again. The size of the task switchingobject 5400 may be established as a default; however, it is not limitedthereto. According to another exemplary embodiment, the size of the taskswitching object 5400 may be determined differently according to thenumber of user favorite functions or most recently executedapplications.

Meanwhile, although FIG. 56 describes the operation when the monochromeobject 5420 is selected within the task switching object 5400, a usermay also select the technicolor object 5410. In this case, favoritefunctions which are previously selected by a user may be executed andprovided through the main area 1010. FIG. 57 is a diagram provided toexplain a process of registering the task switching object 5400 byselecting a favorite function.

5710 of FIG. 57 illustrates that some screen is displayed on the mainarea 1010, and the task switching object 5400 is displayed on the subarea 1020. For example, 5710 of FIG. 57 illustrates a transmittingscreen in which a user calls a specific person on the main area 1010.Within the transmitting screen, a person image 5711, a messageindicating that calling is processing 5712, and a relevant menu 5713 maybe included. The user may input a preset gesture 5714, and register thefunction of calling a corresponding person on the task switching object5400. 5710 of FIG. 57 illustrates that the user performs the gesture5714 by touching the main area 1010 with two fingers, and dragging orflicking the touching toward the sub area 1020 direction.

When such gesture 5714 is inputted, the controller 200 adds thecurrently executing function, i.e., calling James to the favoritefunction area within the task switching object 5400. The controller 200may generate an object 5721 indicating a corresponding function, movethe object 5721 toward a direction of the favorite function area, andexpand the size of the technicolor object 5410 corresponding to thefavorite function area so as to intuitively inform a user of adding thecorresponding function to the favorite function area. The technicolorobject 5410 may be expressed in different colors per application, anddifferent functions provided from the same application may be expressedin different contrasts.

For example, the calling James may be expressed in thick red colors, andthe calling Andy may be expressed in light red colors. Meanwhile, thesending a message to James may be expressed in blue colors. Whenregistering completes, the controller 200 displays the task switchingobject 5400 displayed on the sub area 1020 in an original size, asillustrated in 5730 of FIG. 57. The controller 200 may display an object5731 corresponding to the newly added function on the most upper portionamong the color objects 5410.

Further, the controller 200 may highlight or flash corresponding object5731 for a certain time so that a user can intuitively recognize thatthe object 5731 corresponds to the newly added function. Meanwhile, thecontroller 200 may perform the function operating on the main area 1010as it does, separately from displaying the task switching object 5400 onthe sub area 1020. Thus, the main area 1010 may display calling screen5700.

FIG. 58 is a diagram provided to explain a method of switching tasks byusing the favorite function area within the task switching object 5400.5810 of FIG. 58 illustrates some screen 5541 displayed on the main area1010, and the task switching object 5400 is displayed on the sub area1020. When a user touches the technicolor object 5410, the controller200 expands the area where the technicolor object 5410 is displayed asillustrated in 5820 of FIG. 58. Further, the controller 200 may displayapplication information 5821 corresponding to the touched technicolorobject on one side of the touched point in the main area 1010. 5820 ofFIG. 58 illustrates that the information 5821 related to the musicapplication is displayed.

When a user inputs a gesture 5822 moving the touched point, thecontroller display application information 5831 corresponding to themodified touched point, as illustrated in 5830 of FIG. 58. In 5830 ofFIG. 58, the information 5821 of the music application is modified intothe information 5831 of “call James” application (i.e., the applicationregistered in FIG. 57).

When a user inputs a gesture 5832 moving the touched point toward themain area 1010 direction, the controller 200 displays executing screen5700 of the “call James” application, in which a user calls James, onthe main area, as illustrated in 5840 of FIG. 58.

FIG. 59 is a diagram provided to explain a method of switching tasks byusing the favorite function area within the task switching object. FIG.59 illustrates task switching area 5917 in different format from thetask switching object 5400 described in FIGS. 54 to 58. Referring to5910 of FIG. 59, the controller 200 displays the task switching area5917 within the sub area 1020. The task switching area 5917 may beexpressed in a vertical line format. It may be constituted that some ofthe vertical lines are color lines corresponding to the favoritefunction area, and other some of the vertical lines are mono color linescorresponding to the running app area; however, it is not limitedthereto.

The controller 200 may display the task switching area 5917 in a reducedformat so as not to greatly cover the sub contents while displayingexecuting screen 5900 of the application selected by a user on the mainarea 1010, and displaying the sub contents 5914, 5915, 5916 related withthe contents 5911, 5912, 5913 within the executing screen 5900 on thesub area 1020. When a user touches the task switching area 5917, anddrags or flicks the touch toward the upper direction, the controller 200expands the task switching area 5917. While the touch is maintained, thecontroller 200 displays preview object 5921 showing an icon or name ofan application corresponding to the touched vertical line, asillustrated in 5920 of FIG. 59. When a user lifts off the touch orinputs dragging or flicking gestures to move the touched point toward adirection of the main area 1010, the controller 200 executes theapplication corresponding to the preview object 5921, and displays theexecuting screen 5931 on the main area 1010.

5930 of FIG. 59 illustrates that an SNS (social network service) programexecutes its service screen 5931 is displayed on the main area 1010 andthe various sub contents 5932 related with the service screen 5931 aredisplayed on the sub area 1020. The controller 200 may display the taskswitching area 5917 in an original size or original format on the subarea 1020 when task switching completes.

According to another exemplary embodiment, the user terminal device 1000may modify the display position of various menus and menu types byconsidering a user's grip on the user terminal device 1000. Thus, theuser terminal device 1000 produced in mobile format may be gripped witha left hand, a right hand, and both hands of a user. Further, the userterminal device 1000 may be rotated toward a horizontal direction, stoodtoward a vertical direction, or laid down to be used according tonecessity. The following will explain various exemplary embodiments ofreconstituting interaction screens by considering the user's grip on theuser terminal device 1000.

FIG. 60 illustrates that a user rotates the user terminal device 1000toward a horizontal direction and grips it with both hands 50-1, 50-2while the user terminal device 1000 is executing the camera application.Referring to FIG. 60, the controller 200 displays live view 6011inputted from the camera 380 on the main area 1010, and various menus6012, 6013, 6014 to control the photographing operation on the sub area1020.

The user terminal device 1000 may determine that a user grips with bothhands based on whether the user touches or approaches the main area 1010and the sub area 1020. If it is determined that a user grips with bothhands, the controller 200 may modify display position of menus 6012,6013, 6014 according to positions of fingers regarding both hands. Forexample, as illustrated in 6010 of FIG. 60, when the user's forefingerof the right hand 50-2 is placed on (a) position, it may display thephotographing menu 6014 to input a photographing command on (a)position. As illustrated in 6020 of FIG. 60, when a user further movestheir right hand 50-2 toward the left and their forefinger moves to (b)position, the controller 200 may move the photographing menu 6014 to (b)position. In this case, display positions of the other menus 6012, 6013may be modified according to display position of the photographing menu6014. For example, when the photographing menu 6014 moves to theposition of the camera turn off menu 6013, the controller 200 may movethe camera turn off menu 6013 to the left and display it as if it hasbeen pushed over by the photographing menu 6014.

Further, when another menu (e.g., 6013) is placed on (b) position, thecontroller 200 may move the photographing menu 6014 to the position thatdoes not overlap with the other menu 6013.

Therefore, a user may easily select a menu even if they grip the userterminal device 1000 with various gestures.

FIG. 61 illustrates that a user rotates the user terminal device 1000toward a vertical direction while the camera application is executing,and grips it with their right hand 50-2. While rotating toward thevertical direction, the main area 1010 may display the live view 6011standing toward the vertical direction.

Referring to FIG. 61, the thumb of the right hand 50-2 is placed towardthe direction of the sub area 1020. The controller 200 determines theposition of the thumb by using the touch sensor or the nearfieldapproaching sensor. Therefore, the controller 200 displays thephotographing menu 6014 on (c) position of the sub area 1020, and theother menu 6012 on modified position according to the position of thephotographing menu 6014.

6110 of FIG. 61 illustrates that a user grips a lower part of the userterminal device 1000, and 6120 of FIG. 61 illustrates that a user gripsan upper part of the user terminal device 1000. Referring to 6120 ofFIG. 61, because the position of the thumb moves from (c) position to(d) position, the controller 200 displays the photographing menu 6014 on(d) position of the sub area 1020. Further, the controller 200 moves anddisplays the other menu 6012 on the upper side as the photographing menu6014 is moved and displayed on the upper side.

According to the above exemplary embodiments, a user may performphotographing by conveniently gripping the user terminal device 1000 andtouching any area of the sub area 1020. Thereby, it may removeinconvenience in which a user needs to check the position of aphotographing button (i.e., photographing menu 6014) with their eyeswhen photographing. Meanwhile, in order to remove confusing possibilitywith user gestures, the controller 200 may not display the menu on apart which is touched with the display surface with the user's grip.

FIG. 62 illustrates that picture contents are displayed on the main area1010 while the user terminal device 1000 is stood in a verticaldirection and gripped with the right hand of a user. Referring to 6210of FIG. 62, the controller 200 displays menu 6212 regarding the picturecontents 6211 on the sub area 1020. The controller 200 may modifydisplay position of the menu 6212 according to position of the thumb ofthe right hand 50-2. 6210 of FIG. 62 illustrates that the menu 6212 isdisplayed on (a) position. When the user taps the menu 6212 with theirthumb, the controller 200 arranges and displays a plurality of menus6221˜6224 in circle format based on (a) position of the thumb, asillustrated in 6220 of FIG. 62. When the user taps one menu 6221 again,the controller 200 performs a controlling operation corresponding to themenu 6221. 6220 of FIG. 62 illustrates that the user taps the expandmenu 6221. When the user taps the expand menu 6221, the controller 200expands and displays the picture contents on the main area 1010, asillustrated in 6230 of FIG. 62.

FIG. 63 illustrates that a user grips the user terminal device 1000 withtheir left hand. Referring to FIG. 63, the other four fingers (i.e.,excluding the thumb) are placed toward the sub area 1020 direction. Thecontroller 200 may display a plurality of menus on the sub area 1020according to positions a, b, c, d of the four fingers.

FIG. 64 illustrates that picture contents are displayed. Referring to6410 of FIG. 64, the controller 200 may display various menus 6412˜6415that can control the picture contents 6411 correspondingly to the fingerpositions a, b, c, d while displaying the picture contents 6411 on themain area 1010. FIG. 64 illustrates that the expand menu 6412, thereduce menu 6413, the play menu 6414, and the share menu 6415 aredisplayed. These menus may be uniform to the menus 6221˜6224 displayedwhen the initial menu 6212 is selected while gripping the user terminaldevice 1000 with a right hand; however, it is not limited thereto.

As illustrated in 6410 of FIG. 64, when a user taps the expand menu6412, the controller 200 displays the expanded picture contents 6421 onthe main area 1010 as illustrated in 6420 of FIG. 64. When the user tapsthe reduce menu 6413 again, the controller 200 may display the reducedpicture contents 6331 as illustrated in 6430 of FIG. 64. The controller200 may modify display positions of the menus 6412˜6415 according to themodified positions when the positions of the four fingers are modified.

The user terminal device 1000 may be in a format in which the two subareas 1020, 1030 provided on both sides of the main area 1010 mayprovide menus on various positions according to a user's grip on theuser terminal device 1000.

FIG. 65 is a diagram provided to explain an operation of the userterminal device 1000 according to such an exemplary embodiment.Referring to FIG. 65, the bended touch screen 100 includes the main area1010, the first sub area 1020, and the second sub area 1030.

FIG. 65 illustrates that a user stands the user terminal device 1000 uptoward a vertical direction, and grips it with their left hand. In thiscase, the thumb is placed on the second sub area 1030 side, and theother fingers placed on the first sub area 1020 side. The controller 200displays menu 6511 or interaction guides 6513, 6514 respectively on theposition of the thumb within the second sub area 1030, and positions ofthe one or more fingers within the first sub area 1020. 6513 of FIG. 65displays web page screen 6512 on the main area 1010, the second sub area1030 displays back menu 6511 on the thumb position, and the first subarea 1020 displays the interaction guide 6513 indicating the scrollfunction and the interaction guide 6514 indicating the multi windowfunction respectively on the forefinger position and the middle fingerposition. The interaction guide may be text or an image to guidecontrolling operations performed when user gestures are inputted on acorresponding area. Although 6510 of FIG. 65 displays the interactionguide format, it may be displayed to be menu. According to variousexemplary embodiments, each of the menu 6511 and the interaction guides6513, 6514 may be continuously displayed on the first and the second subareas 1020, 1030, or displayed for a certain time and closed. If theyare closed, they may be displayed again when the fingers approach ortouch each of the sub areas 1020, 1030.

6520 of FIG. 65 illustrates operation when a user taps one item withinthe web page screen 6512 displayed on the main area 1010. In this case,the controller 200 displays a screen 6521 corresponding to the item onthe main area 1010. When the user inputs gestures to touch the firstinteraction guide 6513 on the first sub area 1020 with the forefinger,and drags or flicks the touch toward one direction, the controller 200displays a new screen area 6531 which was not previously displayed onthe main area 1010 by scrolling the screen 6521, as illustrated in 6530of FIG. 65.

Meanwhile, when the user touches the back menu 6511 on the second subarea 1030 with their thumb, the controller 200 displays the previousscreen 6512 again by executing the back function, as illustrated in 6540of FIG. 65.

Further, as illustrated in 6540 of FIG. 65, when the user touches thesecond interaction guide 6514 within the first sub area 1020 with theirmiddle finger, the controller 200 executes the multi window function todivide the screen displayed on the main area 1010 into a plurality ofscreens. 6550 of FIG. 65 illustrates displaying the screen when themulti window function is performed. As illustrated in 6550 of FIG. 65,the controller 200 displays boundary line 6553 on a positioncorresponding to the point which a user touches and lifts off, anddisplays two different screens 6551, 6552 with each other on each sideof the boundary line 6553, respectively. The user may touch the boundaryline 6553 again and modify the position.

Meanwhile, a user touch or approach interaction on the sub area may beused on the unlock function of the user terminal device 1000. In userterminal devices of the related art, an unlock function to release alock screen is executed when a user draws some pattern on the displayand inputs a password. Accordingly, when another person in thesurrounding area may watch the user inputting the pattern or password,and learn the pattern or password. According to exemplary embodiments,security may be further enhanced when the user's grip of the userterminal device 1000 with respect to the sub area is considered whenperforming the unlocking.

FIG. 66 is a diagram provided to explain a method for performing theunlocking by using both of the main area and the sub area according toan exemplary embodiment.

FIG. 66 illustrates that a user touches a part of the sub area 1020 anddraws some pattern on the main area 1010 while gripping the userterminal device 1000. When the drawn pattern matches a previouslydetermined pattern when the pattern is drawn while touching is performedon the prestored sub area 1020 position, the controller 200 maydetermine that the user has authorization and perform the unlocking.Specifically, the controller 200 determines the authorization bycomparing drawing tracks sensed in the main area 1010 with the prestoredunlock pattern in the storage 310. The controller 200 further determinesthe authorization by comparing position or number of touched pointssensed in the sub area 1020 with the unlock point information prestoredin the storage 310. When both of the drawing pattern and the touchpoints match with the prestored information, the controller 200 mayactivate the main area 1010 and display a home screen.

FIG. 67 is a diagram provided to explain another exemplary embodimentregarding the method for performing the unlocking by using the main areaand the sub area. Referring to FIG. 67, a user may modify the touchedposition within the sub area 1020 while drawing the pattern.Specifically, as illustrated in 6710 and 6720 of FIG. 67, a user maytouch three points 6711, 6712, 6713 with three fingers when they aredrawing to consecutively pass through objects 1, 2, 3 within the mainarea 1010, and then pull off one finger so as to touch only the twopoints 6712, 6713 when they are drawing to pass through objects 4, 5.The controller 200 may divide the drawing pattern per section, determinethe touched points or number of touches on the second sub area 1020 ineach pattern section, and determine whether the user has authorization.During registering of the unlock pattern, a user may store a complexunlock pattern information in the storage 310 by inputting a drawing onthe main area 1010 and performing the touch with their fingers on thesub area 1020.

According to the above exemplary embodiments, the controller 200 maysense whether a user touches or approaches the user terminal device 1000by using the touch sensor or the nearfield approach sensor, anddetermine finger positions based on the sensing results.

FIG. 68 is a diagram provided to explain an operation of the nearfieldapproach sensor to sense finger position. FIG. 68 illustrates oneexample of the sectional structure regarding the main area 1010 and thesub areas 1020, 1030.

Referring to FIG. 68, the bended touch screen 100 may include aninfrared source 111, a display panel 112, and an infrared sensor 113.

The display panel 112 may be implemented to be format in which aplurality of gate lines and a plurality of data lines are crossed witheach other to form pixel areas. When the display panel 112 is OLED type,each pixel area may be implemented in format in which R (Red), G(Green), and B (Blue) light-emitting components (e.g., OLED) are formed.Further, each pixel area forms switching components, i.e., TFT. Thelower side of each pixel area may arrange sensors to sense user gesturesmade by a user's body or a pen. Thus, various sensors are provided withthe display panel 112, and user gestures may be sensed on a pixel basis.

The infrared source 111 is provided on one surface of the display panel112, and the infrared sensor 113 is provided on another surface of thedisplay panel 112. The infrared source 111 projects infrared lightstoward the surface direction of the display panel 112. Thereby, somearea that can recognize approaching of a user finger 50 is formed on thesurface of the display panel 112. This area becomes effectiverecognizing area 6805 that can recognize whether the display panel 112is approached or not.

The infrared sensor 113 may include a plurality of infrared sensingcomponents arranged in an array format. Thus, when the finger 50approaches within the effective recognizing area 6805, the infraredsensor 113 may generate infrared scan images by sensing infrared lightsreflecting from the finger 50. The controller 200 may sense theapproaching inputting by using the infrared scan images. When theapproaching input is sensed, the controller 200 may determine theapproaching position of the user finger 50 by confirming the coordinatevalues of the infrared sensing components to sense approaching inputtingwithin a corresponding area.

In addition to the units illustrated in FIG. 68, the bended touch screen100 may further include other various units, or may also have fewer ofthe units.

Meanwhile, as described above, the bended touch screen may beconstituted in format which the plane including the main area and theplane including one or more sub area are connected and fixed with eachother to form an obtuse angle. Thereby, a boundary area is providedbetween the main area and the sub areas. The following will explainvarious exemplary embodiments of performing interactions by using theboundary area.

FIG. 69 illustrates a constitution of the user terminal device 1000including the main area 1010, the sub area 1020 and the boundary area1050 between the above two areas. Although FIG. 69 illustrates a lineformat of the boundary area 1050, the boundary area 1050 may be an areahaving more than a certain size when the main area 1010 and the sub area1020 are connected by a smoothly curved angle. A user may touch one ofthe main area 1010 and the sub area 1020, and input a gesture 6911dragging or flicking toward different area direction (d1 or d2). Thus, auser may input the gesture 6911 to pass through the boundary area 1050between the main area 1010 and the sub area 1020. Such gesture 6911 maybe mapped with functions different from the gestures performed only onthe main area 1010 or the gestures performed only on the sub area 1020.

The controller 200 may determine that dragging or flicking is performedtoward the d2 direction, when the touch is consecutively sensed on thesurrounded sub area 1020 while the touch is first performed on the mainarea 1010 and not lifted off. Meanwhile, the controller 200 maydetermine that a user gesture is performed toward the d1 direction whenthe touch is consecutively sensed on the surrounded main area 1010 whilethe touch is first performed on the sub area 1020 and not lifted off.The controller 200 may perform different controlling operationsaccording to the types of contents displayed on the main area 1010 orthe sub area 1020 and the directions of user gestures.

FIG. 70 illustrates that electronic book contents 7011 are displayed onthe main area 1010. Referring to 7010 of FIG. 70, a user may touch somepoint T1 within the sub area 1020, and input a gesture 7012 passingthrough the boundary area 1050 by dragging or flicking toward the mainarea 1010 direction, i.e., the d1 direction. When such gesture 7012 isinputted, the controller 200 may display graphic effects as if bookpages are turned over as illustrated in 7020 of FIG. 70, and displaynext page 7012 of the electronic book contents. On the contrary, whenthe gestures is inputted toward the d2 direction (not illustrated), thecontroller 200 may display the previous page of the current page 7011.

Meanwhile, when dragging or flicking is performed within the main area1010, the controller 200 may perform scrolling of the page which iscurrently displayed toward the gesture's direction, or modifying intoanother electronic book contents.

FIG. 71 is a diagram provided to explain another exemplary embodiment ofinteractions by using the boundary area. Referring to FIG. 71, a usermay touch the boundary area 1050, and input gestures moving toward thed1 or d2 direction. Such gestures may be distinguished and mapped withfunctions different from the other gestures.

FIG. 72 is a diagram provided to explain another exemplary embodiment ofinteractions by using the boundary area. Referring to FIG. 72, a usermay touch the boundary area 1050, and input a gesture 7210 moving thetouched point so as to follow the boundary area 1050 toward a d3 or d4direction. Such gestures may be also distinguished and mapped withfunctions different from the other gestures.

FIG. 73 is a diagram of an exemplary embodiment of a game applicationscreen which uses the gestures of FIG. 72. Referring to FIG. 73, thegame screen 7310 may be displayed on the main area 1010, and an object7321 related with the game may be displayed on the sub area 1020. Forexample, FIG. 73 illustrates that the object 7321 in flash format isdisplayed on the sub area 1020. On the game screen 7310, only the arealighted by the flash object 7321 may be displayed brightly, and theother areas may be displayed darkly. A user may modify the area lightedby the flash object 7321 by touching the boundary area 1050 and draggingthe touch toward the d3 or d4 direction, thereby improving enjoyment ofplaying the game.

FIG. 74 is a diagram provided to explain another exemplary embodiment ofusing the gestures in FIG. 72.

Referring to FIG. 74, the user terminal device 1000 may display musicreproducing screen 7411 on the main area 1010, and album jacket pictures7412 including the music contents or other information regarding themusic contents on the sub area 1020, when the music applicationexecutes. When a user touches the boundary area 1050 as illustrated in7410 of FIG. 74, the controller 200 displays preview image 7421regarding a home screen on the main area 1010 and the sub area 1020 nearto the touched point 7413.

7420 of FIG. 74 illustrates that the preview image 7421 is sliding downfrom the upper direction of a right diagonal line to the lower directionof a left diagonal line. As illustrated in 7430 of FIG. 74, when a userinputs a gesture 7431 dragging or flicking toward the main area 1010direction, the controller 200 rotates the preview image 7421 toward themain area 1010 direction and displays a home screen 7441 on the whole ofthe main area 1010, as illustrated in 7440 of FIG. 74. Further, thecontroller 200 displays an object corresponding to the home screen 7441on the sub area 1020.

FIG. 75 is a diagram provided to explain another exemplary embodiment ofusing the gestures in FIG. 72. Referring to 7510 of FIG. 75, when a usertouches the boundary area 1050, the preview image 7421 regarding a homescreen may be displayed near to the touched point. When a user performsdragging toward the lower direction 7521, 7532 follows the boundary area1050, and a plurality of screen images 7522 are consecutively displayedaccording to the dragging, as illustrated in 7520, 7530 of FIG. 75.

For example, the preview image 7421 regarding a home screen is initiallydisplayed, and preview images regarding various application screens suchas APP01, APP02, APP03 may be displayed according to the dragging. Whena user inputs gesture 7533 dragging or flicking toward the main area1010 direction, the controller 200 displays a screen 7541 correspondingto the finally displayed preview image 7531 on the main area 1010, anddisplays an object 7542 corresponding to the screen 7541 on the sub area1020, as illustrated in 7540 of FIG. 75. FIG. 75 illustrates thataddress book information is displayed on the main area 1010, and theobject 7542 indicating an index is displayed on the sub area 1020.

FIG. 76 is a diagram provided to explain another exemplary embodiment ofusing the gestures in FIG. 72. Referring to 7610 of FIG. 76, when a userinputs a gesture 7611 dragging from the end part of the boundary area1050 to the lower direction while APP01 is displayed on the main area1010, the controller 200 displays a preview image 7621 regarding anotherapplication screen APP02 according to the dragging. Referring to 7620 ofFIG. 76, the controller 200 may display as if the APP01 screen is pulledover by the dragging and the lower APP02 screen appears. When the userfurther drags toward the lower direction 7612, the controller 200 mayconsecutively display preview images 7621, 7622, 7623, 7624 regarding aplurality of screens, as illustrated in 7630 of FIG. 76. When the usercompletes the dragging, such preview images 7621, 7622, 7623, 7624 maybe displayed for a certain time before being closed. When the userselects one preview image before the preview images 7621, 7622, 7623,7624 are closed, a screen corresponding to the selected preview image isdisplayed on the main area 1010. 7630 and 7640 of FIG. 76 illustratethat APP03 is selected. The controller 200 displays screen 7641 of theselected APP03 on the main area 1010, and the sub contents related withAPP03 on the sub area 1020.

According to another exemplary embodiment, when gestures moving alongthe boundary area 1050 are inputted, the controller 200 may lay down thecurrently displayed screen on the main area 1010 toward the backdirection and display a plurality of objects, as illustrated in FIG. 56.

Meanwhile, a user may perform interactions by using pinch gestures. FIG.77 illustrates a pinch-in gesture in which a user respectively touches apoint (T1) on the main area 1010 and a point (T2) on the sub area 1020with a plurality of fingers, and gathers the touched points toward theboundary area 1050. Similarly, a user may input a pinch-out gesture byrespectively touching the main area 1010 and the sub area 1020 with aplurality of fingers and expanding the interval between the touchedpoints. The controller 200 performs controlling operations mapped withthe gestures when the pinch-in gestures and the pinch-out gestures areinputted.

FIG. 78 is a diagram provided to explain one example regarding acontrolling operation when the pinch-out gesture is inputted. 7810 ofFIG. 78 illustrates that the user terminal device 1000 is locked. Whenthe user terminal device 1000 is locked, the controller 200 mayrespectively turn off the main area 1010 and the sub area 1020. Whenfirst pinch gesture is inputted, the controller 200 may perform anunlock operation to activate the user terminal device 1000. The firstpinch gesture may be a pinch-out gesture.

7810 of FIG. 78 illustrates that a user performs the pinch-out gestureby touching the boundary area 1050 between the main area 1010 and thesub area 1020 respectively with a plurality of fingers (T1, T2), andexpanding the interval between the touched points. The pinch-out gesturedoes not necessarily start from the boundary area 1050. Instead, thecontroller 200 may determine that the pinch-out gesture is inputted whena user respectively touches the main area 1010 and the sub area 1020,and expands the interval between the touched points.

Referring to 7820 of FIG. 78, the controller 200 performs the unlockingas the pinch-out gesture is inputted, and displays a home screen 7821 onthe main area 1010. Further, the controller 200 may display an objectcorresponding to the home screen 7821 on the sub area 1020.

Meanwhile, when a second pinch gesture is inputted while the userterminal device 1000 is unlocked, the controller 200 may perform thelocking to inactivate the user terminal device 1000. The second pinchgesture may be a pinch-in gesture.

FIG. 79 is a diagram provided to explain a method for performing thelocking. Referring to 7910 of FIG. 79, the controller 200 may sensewhether the pinch-in gesture is inputted while some screen 7911 isdisplayed on the main area 1010, and while the object 7912 correspondingto the screen 7911 is displayed on the sub area 1020. When a user inputsthe pinch-in gesture by respectively touching one point (T1) within themain area 1010 and one point (T2) within the sub area 1020 and gatheringthe interval between the touched points, the controller 200 may performthe locking to respectively turn off the main area 1010 and the sub area1020, as illustrated in 7920 of FIG. 79.

The pinch-in gestures and the pinch-out gestures may also be inputtedfollowing along the boundary area 1050.

FIG. 80 illustrates one example of operation when the pinch-out gestureis inputted following along the boundary area. Referring to 8010 of FIG.80, a user may input the pinch-out gesture by respectively touching thetwo points (T1, T2) on the boundary area 1050 with a plurality offingers and expanding the touched points while the user terminal device1000 is inactivated. 8010 of FIG. 80 illustrates that the pinch-out isperformed by L1.

When the pinch-out gesture is performed following along the boundaryarea 1050, the controller 200 may activate sections on the main area1010 and the sub area 1020 respectively by the distance over which thepinch-out gesture is performed, i.e., L1, as illustrated in 8020 of FIG.80. The controller 200 displays screens 8021, 8022 within the activatedsections on the main area 1010 and the sub area 1020.

FIG. 81 is a diagram provided to explain an operation of inactivatingsections while the user terminal device 1000 is unlocked. 8110 of FIG.81 illustrates that a user performs the pinch-in gesture following alongthe boundary area 1050 while some screen 8111 is displayed on the mainarea 1010 and an object 8112 corresponding to the screen 8111 isdisplayed on the sub area 1020. The user may perform the pinch-ingesture by touching the two points (T1, T2) on the boundary area 1050with two fingers, moving the touched points respectively toward d3 andd4 directions, and gathering the interval.

When the pinch-in gesture is inputted, the controller 200 inactivatesthe sections on the main area 1010 and the sub area 1020, as illustratedin 8120 of FIG. 81. Specifically, the controller 200 turns off thesections on the main area 1010 and the sub area 1020 which correspond tothe distance performed by the pinch-out gesture, i.e., L2. Thereby, themain area 1010 displays the screen 8111 on the area excluding theturned-off section 8121 and the object 8112 on the area excluding theturned-off section 8122.

FIG. 82 is a diagram provided to explain an operation when the pinchgesture is performed on the sub area. Referring to 8210 of FIG. 82, ahome screen 8211 may be displayed on the main area 1010, and an object8212 corresponding to the home screen 8211 may be displayed on the subarea 1020. When a user inputs the pinch-in gesture 8213 by touching thesub area 1020 with a plurality of fingers and gathering the intervalbetween the touched points, the controller 200 may inactivate thesections of the areas in which the main area 1010 and the sub area 1020respectively become darker from the both ends. Thereby, as illustratedin 8220 of FIG. 82, the main area 1010 and the sub area 1020 enter aturned-off state according to the distance from the upper end to thefirst point (T1) touched by the user, i.e., L3 and the distance from thelower end to the second point (T2) touched by the user, i.e., L4, andthe screen 8211 is displayed between the area excluding for theturned-off sections.

When a user performs the pinch-in gesture 8213 to gather the first andthe second touched points to meet with each other as illustrated in 8220of FIG. 82, the controller 200 turns off all of the main area 1010 andthe sub area 1020 by performing the locking. 8230 of FIG. 82 illustratesthat the user terminal device 1000 is locked by the pinch-in gesture.

Meanwhile, although FIG. 82 illustrates the exemplary embodiment whichthe user terminal device 1000 is controlled with a pinch gestureinputted on one sub area 1020, when the bended touch screen 100including the constitution described in FIGS. 6 and 7 is provided, auser may input gestures dragging toward the center or dragging out fromthe center toward the first sides and the second sides whilesimultaneously gripping the first sides of the first and the second subareas 1020, 1030 with two fingers of the right hand and simultaneouslygripping the second sides of the first and the second sub areas 1020,1030 with two fingers of the left hand. The controller 200 may performthe locking or the unlocking according to such user gestures.

FIG. 83 is a diagram provided to explain an exemplary embodiment ofperforming interactions according to various user gestures inputtedthrough the main area and the sub area. Referring to 8310 of FIG. 83, auser may input a gesture 8311 dragging the sub area 1020 while the userterminal device 1000 is inactivated. When the user gesture 8311 isinputted, the controller 200 activates the sub area 1020 as illustratedin 8320 of FIG. 83. The controller 200 may gradually activate the subarea 1020 according to the direction in which the user gesture 8311 isperformed. 8320 of FIG. 83 illustrates that a time object 8321indicating the current time is displayed while the sub area 1020 isactivated from the upper end toward the lower end. When the user gesture8311 is performed for more than a certain distance, the whole of the subarea 1020 is activated as illustrated in 8330 of FIG. 83. When a userinputs a gesture 8332 selecting one object and dragging or flicking theselection toward the main area 1010 direction, the controller 200activates the main area 1010. Further, the controller 200 modifies anddisplays the corresponding object 8321 into home icon 8341 asillustrated in 8340 of FIG. 83, and displays a home screen 8351 when thetouch is lifted off, as illustrated in 8350 of FIG. 83. The sub area1020 displays an object 8352 corresponding to the home screen 8351. Thescreen 8351 may display widgets, icons, and text.

When a user inputs the pinch-in gesture 8353 on the home screen 8351,the controller 200 displays an application list 8361 by reducing thehome screen 8351 as illustrated in 8360 of FIG. 83. Further, thecontroller 200 summarizes objects 8352 displayed on the sub area 1020and displays one layer panel 8362. When the user inputs the pinch-outgesture 8363, the controller 200 displays the home screen 8351 and theobject 8352 on the main area 1010 and the sub area 1020 again asillustrated in 8370 of FIG. 83.

FIG. 84 is a diagram provided to explain a method for performing theback function by using the boundary area. 8410 of FIG. 84 illustratesthat picture contents 8411 are displayed across the main area 1010 andthe sub area 1020. The picture contents 84110\ indicate picture imagesdisplayed when one thumbnail image is selected within the executingscreen of the gallery program.

When a user touches the boundary area 1050, and inputs a gesture 8412dragging or flicking toward the sub area 1020 direction, the controller200 displays gallery screen 8421 prior to the picture contents on themain area 1010, and displays a plurality of objects 8422 correspondingto the gallery screen 8421 on the sub area 1020. 8420 of FIG. 84illustrates that the gallery screen 8421 and the objects 8422 arerespectively displayed on the main area 1010 and the sub area 1020. Whenthe user touches the boundary area 1050 and inputs a gesture 8423dragging or flicking toward one direction, the controller 200 deletessome of the gallery screen 8421 currently displayed according to theuser gesture 8423, and exposes the home screen 8351 and its objects8352. When the user inputs user gesture 8431 to expand the exposed area,the controller 200 removes the gallery screen 8421, and respectivelydisplays the home screen 8351 and the objects 8352 on the main area 1010and the sub area 1020.

FIG. 85 is a diagram provided to explain another method for performingthe back function by using the boundary area. Referring to 8510 of FIG.85, when the picture contents 8511 are displayed across the main area1010 and the sub area 1020, a user may an input gesture 8512 dragging orflicking along to the boundary area 1050.

The controller 200 displays the gallery screen 8521 and its object 8522in response to the user gesture 8512, as illustrated in 8520 of FIG. 85.When the user touches the boundary area 1050 and inputs gestures 8523,8531 dragging for more than a certain distance following along theboundary area, the controller 200 consecutively displays a plurality ofobjects 8532˜8536 indicating using history according to dragging points,as illustrated in 8530 of FIG. 85. The last one object 8536 among theobjects may correspond to a home screen. When dragging completes, ascreen corresponding to the displayed object at the completing time isdisplayed on the main area 1010. For example, when the user performs thedragging to the last object, the controller 200 displays the home screen8531 on the main area 1010 as illustrated in 8540 of FIG. 85, anddisplays the objects 8532 corresponding to the home screen 8531 on thesub area 1020.

According to the various exemplary embodiments, the user terminal device1000 may perform various controlling operations according to theinputted user gestures when user gestures regarding the boundary area1050 dividing the main area 1010 and the sub area 1020 are inputted inaddition to user gestures regarding the main area 1010 and the sub area1020. User gestures inputted on the boundary area 1050 may be variousgestures such as a first user gesture scrolling along the boundary area1050, a second user gesture touching the boundary area 1050 and movingthe touched point toward the main area 1010 direction, a third usergesture touching the boundary area 1050 and moving the touched pointtoward the sub area 1020 direction, pinch-in gestures performed on theboundary area 1050, pinch-out gestures, pinch-in gestures gatheringtoward the boundary area 1050, and pinch-out gestures starting from theboundary area 1050. When one of such gestures is sensed, the userterminal device 1000 may perform different controlling operationsaccording to the sensed user gestures.

The user terminal device 1000 may provide various interactions bycombining the main area 1010 and the sub area 1020.

FIG. 86 is a diagram provided to explain an exemplary embodiment ofusing the sub area as a clip board. As illustrated in FIG. 86, the userterminal device 1000 may display a web page screen 8610 or otherapplication screens on the main area 1010, and display the clip board8620 on the sub area 1020. When a user selects an object 8611 such asspecific image or text within the screen 8610, and inputs a gesture 8612dragging the selection toward the sub area 1020 direction, thecontroller 200 separately stores the selected object 8611, and displaysa sub object 8621 corresponding to the selected object 8611 on the clipboard 8620 within the sub area 1020.

FIG. 87 is a diagram provided to explain an exemplary embodimentregarding operation of the user terminal device 1000 in which a user canperform keyboard typing. Referring to FIG. 87, the user terminal device1000 may display a keyboard screen 8710 including a keyboard andcharacter display area where characters inputted through the keyboardare displayed on the main area 1010. When the user tilts the userterminal device 1000 toward the main area 1010 direction, and inputsgesture 8711 dragging toward the main area 1010 direction after touchingthe sub area 1020, the controller 200 modifies the keyboard within thekeyboard screen 8710 into special key window 8721. The user may inputspecial characters, symbols, or numbers by selecting keys within thespecial key window 8721. When there are a plurality of special keywindows, the controller 200 may consecutively modify and display anotherspecial key window whenever the tilting of the user terminal device 1000or the gesture 8711 is repeatedly inputted.

FIG. 88 is a diagram of an exemplary embodiment regarding operation ofthe user terminal device 1000 which reproduces multimedia contents.Referring to FIG. 88, the controller 200 executes a reproducing program,reproduces the multimedia contents selected by a user, and displays thereproducing screen 8810 on the main area 1010 when user gestures toreproduce multimedia contents are inputted. Further, the controller 200displays a play bar 8820 indicating how much of the multimedia contentshave been produced on the sub area 1020. When the user moves theirfinger toward the sub area 1020 direction, the controller 200 maydisplay various controlling menus to control a reproducing operation ofthe multimedia contents on the sub area 1020. The method for sensing theapproaching is described in the above exemplary embodiments and will notbe further explained.

FIG. 89 is a diagram of another exemplary embodiment regarding anoperation of the user terminal device 1000 which reproduces multimediacontents. Referring to FIG. 89, the controller 200 may generate anddisplay the reproducing screen 8910 of the multimedia contents selectedby a user in a cassette tape format on the main area 1010, and displaythe upper or the lower image of the cassette tape on the sub area 1020.Thus, according to an exemplary embodiment, the user terminal device1000 may provide 3D graphic interaction screen in format similar to theitem by using the main area 1010 and one or more of the sub areas 1020,1030. Although FIG. 89 illustrates the exemplary embodiment ofreproducing the music contents, it may provide 3D graphic interactionscreen in a format corresponding to the reproduced content (e.g., anelectronic book or video).

FIG. 90 is a diagram of an example of interaction screen displayed whena payment is performed by using the user terminal device 1000. Referringto FIG. 90, the main area 1010 of the user terminal device 1000 maydisplay payment screen 9010 including various information such as couponinformation, payment tool information, personal information, andpurchasing goods information. Further, the sub area 1020 may display abarcode 9020 corresponding to the selected item on the payment screen9010 or other graphic objects. When the item is modified, the controller200 may modify the object displayed on the sub area 1020 so as to besuitable for the modified item. For example, when a credit card to beused to pay is modified on the payment screen 9010, the controller 200may display the barcode 9020 corresponding to the modified credit cardon the sub area 1020.

Even if a user does not execute another application, a status of theuser terminal device 1000 may be expressed by using a sensitiveinteraction screen.

FIG. 91 illustrates an exemplary embodiment of an interaction screendisplayed when charging the battery. 9110 of FIG. 91 illustrates thatthe user terminal device 1000 is charging the battery while being laiddown. The controller 200 inactivates the main area 1010, and displaysthe charging degree by using the sub area 1020. Referring to 9110 ofFIG. 91, when the charging begins, the controller 200 displays thatdimensional particles 9112 are falling down and piled up within the subarea 1020. The depth of particle layer 9111 piled up on the ground ofthe sub area 1020 is differently marked according to the charging degreeof the battery. When the charging is complete (i.e., the battery ischarged to 100%), the sub area 1020 is fully filled with the particles9112.

9120 of FIG. 91 illustrates that the user terminal device 1000 ischarging the battery while being stood vertically. In this case, thecontroller 200 inactivates the main area 1010, and displays the chargingdegree by using the sub area 1020. The dimensional particles 9122 withinthe sub area 1020 are piled up as if influenced by the gravity and formthe particle layer 9121. As described above, the depth of the particlelayer 9121 is displayed differently according to the charging degree.When the charging completes, the sub area 1020 is fully filled with theparticles 9122. Such dimensional particles 9122 may be expressed invarious formats such as snow, sand, rain, water drops, and mill powder.Although FIG. 91 illustrates that the particles 9122 are piled up on alower side of the user terminal device 1000 as if influenced by gravity,the user terminal device 1000 may express the particles 9122 as if theyare blowing with the wind by recognizing user motion, or as if they aremoving with the influence of the inertia by the movement of the userterminal device 1000.

The user terminal device 1000 may provide various formats ofinteractions by using the main area 1010 and the sub area 1020. FIGS. 92to 96 are diagrams explaining various examples regarding suchinteractions.

First, referring to FIG. 92, the controller 200 may display adimensional piano key screen 9210 by using the main area 1010 and thesub area 1020. When a user touches 9212 corresponding to piano key 9211among the piano keys displayed on the sub area 1020, the controller 200may output an audio signal corresponding to the touched piano key 9211through the speaker 390 while displaying graphic effects as if thetouched piano key 9211 displayed on the main area 1010 is rising up.This exemplary embodiment may also be applied in various games or musicplaying programs, but is not limited thereto.

FIG. 93 is a diagram of an exemplary embodiment of highlighting portionson some screen of the main area by using the sub area. Referring to FIG.93, when a user touches a point 9321 within the sub area 1020 whilescreen 9310 including a plurality of items is displayed on the main area1010, an item 9311 corresponding to the touched point 9321 may behighlighted. A user may modify a highlighted item by dragging thetouched point toward the d1 or d2 direction. This exemplary embodimentmay also be applied in various games or presentation programs, but isnot limited thereto.

FIG. 94 is a diagram of an exemplary embodiment of expanding some screenon the main area by using the sub area. Referring to FIG. 94, when auser touches a point 9421 within the sub area 1020 while screen 9410including a plurality of items is displayed on the main area 1010, anitem 9411 corresponding to the touched point 9421 may be expanded anddisplayed. The user may modify an expanded and displayed item bydragging the touched point 9421 toward the d1 or d2 direction. Further,when the touching time becomes longer, the controller 200 may adjust theexpansion ratio proportionally to the touching time. Thus, thecontroller 200 may expand the item 9411 to be bigger when the usertouches longer, and display a link screen corresponding to the item 9411on the main area 1010 when the time exceeds the initial time. Thisexemplary embodiment may also be applied in various games orpresentation programs, but is not limited thereto.

FIG. 95 is a diagram of an exemplary embodiment of modifying some itemson the main area by using the sub area. Referring to FIG. 95, when auser touches a point 9521 within the sub area 1020 while screen 9510including a plurality of items is displayed on the main area 1010, anitem 9511 corresponding to the touched point 9521 may be modified. FIG.95 illustrates that a line 9512 of the item 9511 among the boundarylines between the main area 1010 and the sub area 1020 is modified to bepushed up toward the main area 1010 direction. This exemplary embodimentmay be used when a user needs to underline or hide a specific itemwithin the screen 9510. This exemplary embodiment may also be applied invarious games or presentation programs, but is not limited thereto.

FIG. 96 illustrates an exemplary embodiment of displaying a sticker-typememo by using the main area and the sub area. Referring to FIG. 96, themain area 1010 of the user terminal device 1000 may display a pluralityof different sticker-type memo papers 9611˜9615, and the sub area 1020may display objects 9621˜9625 showing that a plurality of memories9611˜9615 are consecutively piled up. A user may select one object 9623among the objects on the sub area 1020, and input a gesture 9631dragging the selected objection 9623 toward the main area 1010direction. The controller 200 may display a peel off effects as ifcorresponding memo paper 9613 is peeled off according to such gesture9631. The controller 200 may move the peeled memo paper 9613 to anotherapplication screen according to following user gestures, and display iton a corresponding screen.

Meanwhile, when the user terminal device 1000 provides the two subareas, a user may control operation of another sub area by touching onesub area.

FIG. 97 is a diagram of operation of the user terminal device 1000according to an exemplary embodiment of controlling another sub area byusing one sub area. Referring to FIG. 97, the user terminal device 1000includes the bended touch screen 100 constituted with the main area1010, the first sub area 1020, and the second sub area 1030. When theuser terminal device 1000 is in a locked situation or in a saving mode,the controller 200 may respectively turn off the main area 1010, thefirst sub area 1020, and the second sub area 1030, or reduce thebrightness of these areas by more than a certain level. When a usertouches a point 9721 within the first sub area 1020, only a point 9722which is opposite or corresponding to the touched point 9721 may bepartly lighted within the opposing second sub area 1030. FIG. 97illustrates that only the part 9722 showing current time is lightedwithin the second sub area 1030 by the user touch, and the other part9723 remains darkened. The controller 200 may display another pointwithin the second sub area 1030 brightly according to the movingposition, when the touched point of a user moves.

FIG. 98 is a diagram of an operation of the user terminal device 1000according to an exemplary embodiment of controlling a display situationof the sub area by using the main area. Referring to FIG. 98, while theuser terminal device 1000 is laid down on a surface, the controller 200may display some contents 9810 on the first sub area 1020. The contentsdisplayed on the first sub area 1020 may be 3D contents havingdimensional feeling. In this situation, a user may touch the main area1010. The controller 200 may display an effect 9812 as if lights orparticles are coming down within the first sub area 1020 according tothe point touched by the user.

For example, when the user touches the main area 1010 while the contents9810 showing forest is displayed on the first sub area 1020, it maydisplay a visual effect 9812 as if the sun is shining on a pointcorresponding to the touched point. The user may freely modify thetouched point within the main area 1010, and the controller 200 mayfreely modify area where the sun is shining according to modifying thetouched point. Thereby, each object within the contents 9810 can beviewed with dimensional feeling. Meanwhile, according to anotherexemplary embodiment, the user may edit the contents 9810 by executingan editing function so as to add such interaction effects. Further, theuser may share the edited contents with another friend.

FIG. 99 is a diagram of operation of the user terminal device 1000according to an exemplary embodiment of displaying the uniform contentsby using a plurality of sub areas. Referring to FIG. 99, the userterminal device 1000 includes the bended touch screen 100 constitutedwith the main area 1010, the first sub area 1020, and the second subarea 1030. As illustrated in FIG. 99, when contents are reproducingwhile the user terminal device 1000 is laid down, the controller 200 maydisplay contents screens respectively on the first area 1020 and thesecond sub area 1030. 9910 of FIG. 99 illustrates that a first contentsscreen 9930 is displayed on the first sub area 1020, and 9920 of FIG. 99illustrates that a second contents screen 9940 is displayed on thesecond sub area 1030.

The first contents screen 9930 and the second contents screen 9940 maybe screens facing the uniform contents from the contrary directions. Forexample, while the first contents screen 9930 may display that person9912 is standing farther away compared to person 9911 (i.e., withrespect to a user viewing the first contents screen 9930), the secondcontents screen 9940 may display that person 9911 is standing farthercompared to person 9912. Thereby, according to the exemplary embodiment,contents can be viewed from different perspectives. Such screensaccording to the exemplary embodiment may be used, for example, in gamesfor two persons or presentations.

FIG. 100 is a diagram of an exemplary embodiment of confirminginformation displayed on the sub area by using the main area. Referringto 10010 of FIG. 100, the user terminal device 1000 includes the mainarea 1010, the first sub area 1020, and the second sub area 1030.

The controller 200 displays a plurality of screens 10011, 10012, 10014respectively on the main area 1010, the first sub area 1020, and thesecond sub area 1030. When a user a touch 10013 for more than a presettime after touching the main area 1010, the controller 200 may displaythe screens 10012, 10014 displayed on the first and the second sub areas1020, 1030 as if they are crawling up toward the main area 1010direction, as illustrated in 10020 and 10030 of FIG. 100. According tothe exemplary embodiment, even if the user does not view the sectionedside, the screens on the sub areas 1020, 1030 may be confirmed on themain area 1010.

The user terminal device 1000 may perform various operations accordingto the types of executing programs in response to user gestures inputtedon the sub areas. For example, if the calendar program is executing whena user inputs touching on the sub area, a menu regarding certaininformation corresponding to the touched point may be displayed on themain area. The user may select various options such as sharing option,schedule registering option, and deleting option. Further, when the userinputs gestures touching and spreading the sub areas, the controller 200may perform operation to expand certain information within the spreadarea.

As described above, according to the above various exemplaryembodiments, a user may perform various interactions by using the mainarea and one or more sub areas. The following will explain interactionmethods according to some of the exemplary embodiments by usingflowcharts.

FIG. 101 is a flowchart explaining the interaction method according toan exemplary embodiment. Referring to FIG. 101, the user terminal device1000 may activate only the sub areas among the main area and the subareas at S10110. For example, when the user terminal device 1000 is laiddown on a surface so that the main area is directed toward the surface,when the user terminal device 1000 is carried in a purse or in a pocket,when the amount of charge remaining in the battery is less than acertain level, when a specific application executes, or when a userinactivates the main area only, the user terminal device 1000 mayactivate one or more sub areas only.

When a user inputs preset user gestures regarding the sub areas atS10120, the user terminal device 1000 may activate the main area atS10130.

Therefore, the user terminal device 1000 may display various screens byusing both of the activated main area and sub areas at S10140.

Meanwhile, according to another exemplary embodiment, when a presetfirst user gesture is inputted while the sub area is inactivated, theuser terminal device 1000 may activate the sub area. When a presetsecond user gesture is inputted on the sub area or when the preset firstuser gesture is inputted again, the user terminal device 1000 mayadditionally activate the main area.

The interaction screens regarding these exemplary embodiments areexplained in the above various exemplary embodiments, and will not befurther described.

FIG. 102 is a flowchart explaining the interaction method according toanother exemplary embodiment. Referring to FIG. 102, the user terminaldevice 1000 determines whether an event to display an application occursor not at S10120. Herein, the event to display an application may bevarious events such as an event to receive messages or emails fromexternal devices, an event to receive signals requesting displaying of aspecific application from external devices, an event receiving an inputuser gesture requesting executing of a specific application anddisplaying the screen, an event in which a preset time periodapproaches, and an event generating an update version regarding anapplication stored in the user terminal device 1000.

When such events occur, the user terminal device 1000 determines whetherthe application should be displayed on the sub area or the main area atS10220. According to a result of the determining, if the applicationshould be displayed on the sub area, the user terminal device 1000displays the application in the first layout on the sub area at S10230.Displaying the application refers to displaying screens generatedaccording to executing the application programs, as set forth theexemplary embodiments. For example, as illustrated in FIG. 15, when theuser terminal device 1000 tilts by more than a certain angle toward adirection in which the sub area is directed at a user, the user terminaldevice 1000 may display the application on the sub area.

Meanwhile, if the application should be displayed on the main area, theuser terminal device 1000 displays the application in the second layouton the main area at S10240. According to the above exemplaryembodiments, if the user terminal device 1000 is gripped such that theuser terminal device 1000 is in a vertical orientation, the userterminal device 1000 may reconstitute and display the application in thesecond layout different from the first layout.

FIG. 103 is a flowchart explaining the interaction method according toanother exemplary embodiment. Referring to FIG. 103, when event todisplay an application occurs at S10310, the user terminal device 1000determines whether the application is to be displayed on the sub area,the main area or all of the main area and the sub area at S10320,S10340.

As a result of the determining, if the application should be displayedon the sub area, the user terminal device 1000 displays the applicationin the first layout on the sub area at S10330.

Further, if the application should be displayed on the main area, theuser terminal device 1000 displays the application in the second layouton the main area at S10340.

Further, when the application should be displayed on all of the mainarea and the sub area, the user terminal device 1000 may display theapplication in the third layout by using all of the main area and thesub area at S10360.

The first, the second, and the third layouts are specifically explainedin FIGS. 13 and 14 and will not be further described.

FIG. 104 is a flowchart explaining the interaction method according toanother exemplary embodiment. Referring to FIG. 104, when the firstpinch gesture is inputted while the user terminal device 1000 isinactivated at S10410, the user terminal device 1000 performs theunlocking to be activated at S10420. When the user terminal device 1000is activated, the main area and the sub area are respectively turned onand various screens are displayed.

When the second pinch gesture is inputted at S10430, or when there is noinputting for a certain time at S10440, the user terminal device 1000performs the locking to be inactivated at S10450. When beinginactivated, the user terminal device 1000 may turn off both of the mainarea and the sub area or turn off the main area only.

The interaction screens according to the exemplary embodiment arespecifically explained in FIGS. 78 and 79 and will not be furtherdescribed.

FIG. 105 is a flowchart explaining the interaction method according toanother exemplary embodiment. Referring to FIG. 105, the user terminaldevice 1000 may display various screens by using the main area and thesub area at S10510. The types of screens that can be displayed by usingthe main area and the sub area are specifically explained in the abovevarious exemplary embodiments and will not be further described.

When the user gestures are inputted on the main area at S10520, the userterminal device 1000 modifies the main contents displayed on the mainarea at S10530. Further, the user terminal device 1000 automaticallymodifies the sub contents displayed on the sub area by interlocking withmodifying situation of the main contents at S10540.

Thereby, a user may perform interactions by comprehensively using themain area and the sub area.

Although FIG. 105 describes that display situation of the sub area ismodified according to the user gestures inputted on the main area,contrary processes may be performed. For example, when user gestures areinputted on the sub area, the user terminal device 1000 may modify thecontents displayed on the main area according to the user gestures.

The above described interactions may be performed in the variousexemplary embodiments; however, specific flowcharts regarding eachexemplary embodiment will not be illustrated and described.

Meanwhile, the constitution regarding the main area and one or more subareas may be variously modified as described in FIGS. 2 to 10. Further,the above various exemplary embodiments may be executed in the userterminal device 1000 including various constitutions described in FIGS.2 to 10.

As described above, the user terminal device 1000 may support variousinteractions. The above exemplary embodiments may be separately executedin each, or combined and executed according to necessity.

The interaction methods of the user terminal device 1000 or the screendisplay methods according to the above various exemplary embodiments maybe stored in non-transitory readable recording medium. Suchnon-transitory readable recording medium may be loaded and used invarious devices.

A non-transitory computer readable recording medium refers to a mediumwhich store data semi-permanently and can be read by devices. Forexample, it may be a CD, DVD, hard disk, Blu-ray disk, USB, memory card,or ROM.

According to an exemplary embodiment, a non-transitory readablerecording medium may be provided by storing and providing program codesto execute performing the unlocking to activate the user terminal device1000 when the first pinch gesture is inputted on one or more area amongthe main area and the sub areas while the user terminal device 1000 islocked, and performing the locking to inactivate the user terminaldevice 1000 when the second pinch gesture is inputted on one or morearea among the main area and the sub areas while the user terminaldevice 1000 is unlocked.

The foregoing exemplary embodiments and advantages are merely exemplaryand are not to be construed as limiting the exemplary embodiments. Theexemplary embodiments can be readily applied to other types ofapparatuses. Also, the description of the exemplary embodiments isintended to be illustrative, and not to limit the scope of the inventiveconcept, as defined by the appended claims, and many alternatives,modifications, and variations will be apparent to those skilled in theart.

What is claimed is:
 1. An electronic device comprising: a displaycomprising: a main surface area; and a curved surface area extended fromthe main surface area; a controller configured to: control the displayto present a preview image on the main surface area and a user interface(UI) on the curved surface area, the UI comprising a UI element forphotographing an image; control the display to present the UI element ata first location in the curved surface area while the electronic deviceis in a landscape state; and control the display to present the UIelement at a second location in the curved surface area while theelectronic device is in a portrait state.
 2. The electronic deviceaccording to claim 1, further comprising: a sensor configured to detecta state of the electronic device, wherein the controller is furtherconfigured to determine whether the state detected by the sensorcorresponds to the portrait state or the landscape state.
 3. Theelectronic device according to claim 2, wherein the sensor comprises agyroscope and the state comprises an orientation of the electronicdevice detected by the gyroscope.
 4. The electronic device according toclaim 3, wherein the first location corresponds to a first orientationdetected by the gyroscope and associated with the portrait state and thesecond location corresponds to a second orientation detected by thegyroscope and associated with the landscape state.
 5. The electronicdevice according to claim 4, wherein the UI comprises a plurality of UIelements comprising the UI element to photograph the image, and whereinthe controller is further configured to display the plurality of UIelements in a first configuration according to the landscape state ofthe electronic device and display the plurality of UI elements in asecond configuration according to the portrait state of the electronicdevice.
 6. The electronic device according to claim 3, wherein thecontroller is further configured to switch display of the UI elementfrom the first location to the second location in response to a switchin the state of the electronic device from the landscape state to theportrait state.
 7. The electronic device according to claim 1, whereinthe display comprises a touchscreen configured to receive a touch input,and wherein the controller is further configured to control theelectronic device to photograph the image in response to the touchscreenreceiving the touch input on the UI element.
 8. The electronic deviceaccording to claim 1, wherein the first location is disposed closer to amiddle of the curved surface area in a longitudinal direction than thesecond location.
 9. An electronic device comprising: a display, thedisplay comprising: a main surface area; and a curved surface areacontinuously extended from the main surface area; and a controllerconfigured to: control the display to present a preview image on themain surface area and a user interface (UI) on the curved surface areathe UI comprising a UI element for photographing an image; control thedisplay to present the UI element at a first location in the curvedsurface area while the electronic device is in a landscape state; andcontrol the display to present the UI element at a second location inthe curved surface area while the electronic device is in a portraitstate.
 10. An electronic device comprising: a display, the displaycomprising: a main surface area; and an auxiliary surface areacontinuously extended at an inclined angle from the main surface area;and a controller configured to: control the display to present a previewimage on the main surface area and a user interface (UI) on theauxiliary surface area the UI comprising a UI element for capturing animage; control the display to present the UI element at a first locationin the auxiliary surface area while the electronic device is in alandscape state; and control the display to present the UI element at asecond location in the auxiliary surface area while the electronicdevice is in a portrait state, the second location being different fromthe first location.